2023-05-19T20:12:24.681 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-19T20:12:24.682 DEBUG:teuthology.run:Teuthology command: teuthology --description rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} --owner scheduled_yuriw@teuthology --name yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi/7278510 --verbose -- /home/teuthworker/archive/yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi/7278510/orig.config.yaml 2023-05-19T20:12:24.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-19T20:12:24.831 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi/7278510 branch: wip-yuri4-testing-2023-05-18-0754-quincy description: rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration} email: yweinste@redhat.com first_in_suite: false job_id: '7278510' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-05-18-0754-quincy ceph: conf: client: rbd default features: 61 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: osd default pool size: 2 install: ceph: flavor: default sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-05-18-0754-quincy sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 6380 sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd sleep_before_teardown: 0 subset: 111/12000 suite: rbd suite_branch: wip-yuri4-testing-2023-05-18-0754-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_465d59c7325658c86eb5d8820da2d8fc49b7a1cd/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd targets: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_migration.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-19_15:10:19 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-19T20:12:24.831 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_465d59c7325658c86eb5d8820da2d8fc49b7a1cd/qa; will attempt to use it 2023-05-19T20:12:24.832 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_465d59c7325658c86eb5d8820da2d8fc49b7a1cd/qa/tasks 2023-05-19T20:12:24.833 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-19T20:12:24.837 INFO:teuthology.task.internal:Checking packages... 2023-05-19T20:12:24.868 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '465d59c7325658c86eb5d8820da2d8fc49b7a1cd' 2023-05-19T20:12:24.868 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-19T20:12:24.869 INFO:teuthology.packaging:ref: None 2023-05-19T20:12:24.869 INFO:teuthology.packaging:tag: None 2023-05-19T20:12:24.869 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-05-18-0754-quincy 2023-05-19T20:12:24.870 INFO:teuthology.packaging:sha1: 465d59c7325658c86eb5d8820da2d8fc49b7a1cd 2023-05-19T20:12:24.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-05-18-0754-quincy 2023-05-19T20:12:25.016 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-368-g465d59c7-1focal 2023-05-19T20:12:25.016 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-19T20:12:25.030 INFO:teuthology.task.internal:no buildpackages task found 2023-05-19T20:12:25.031 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-19T20:12:25.040 INFO:teuthology.task.internal:Saving configuration 2023-05-19T20:12:25.052 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-19T20:12:25.060 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-19T20:12:25.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi/7278510', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-19 20:05:29.023625', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-05-19T20:12:25.089 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-19T20:12:25.098 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-05-19T20:12:25.098 INFO:teuthology.run_tasks:Running task console_log... 2023-05-19T20:12:25.174 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a8c925dc0>, signals=[15]) 2023-05-19T20:12:25.175 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-19T20:12:25.186 INFO:teuthology.task.internal:Opening connections... 2023-05-19T20:12:25.187 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:12:25.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-19T20:12:25.242 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-19T20:12:25.256 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-05-19T20:12:25.367 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-05-19T20:12:25.367 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-05-19T20:12:25.375 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-05-19T20:12:25.375 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-05-19T20:12:25.375 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-05-19T20:12:25.375 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-19T20:12:25.376 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2023-05-19T20:12:25.377 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2023-05-19T20:12:25.377 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-05-19T20:12:25.401 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-19T20:12:25.411 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-19T20:12:25.423 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-19T20:12:25.424 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2023-05-19T20:12:25.430 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-19T20:12:25.441 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-19T20:12:25.441 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2023-05-19T20:12:25.481 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-19T20:12:25.521 INFO:teuthology.run_tasks:Running task kernel... 2023-05-19T20:12:25.543 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-05-19T20:12:25.544 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-05-19T20:12:25.545 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-19T20:12:25.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-19T20:12:25.551 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-05-19T20:12:25.557 INFO:teuthology.orchestra.run.smithi163.stdout:5.4.0-124-generic 2023-05-19T20:12:25.557 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.4.0-124-generic 2023-05-19T20:12:25.557 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2023-05-19T20:12:25.642 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2023-05-19T20:12:25.796 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-19T20:12:25.809 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-05-19T20:12:25.867 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-05-19T20:12:25.911 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-05-19T20:12:26.183 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,550 kB] 2023-05-19T20:12:26.311 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [819 kB] 2023-05-19T20:12:26.327 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [432 kB] 2023-05-19T20:12:26.330 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.5 kB] 2023-05-19T20:12:26.331 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-05-19T20:12:26.331 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,855 kB] 2023-05-19T20:12:26.344 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [261 kB] 2023-05-19T20:12:26.346 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-05-19T20:12:26.380 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,062 kB] 2023-05-19T20:12:26.496 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [591 kB] 2023-05-19T20:12:26.512 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [727 kB] 2023-05-19T20:12:26.522 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [252 kB] 2023-05-19T20:12:26.525 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [24.3 kB] 2023-05-19T20:12:26.526 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-05-19T20:12:26.529 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-05-19T20:12:26.529 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-05-19T20:12:26.530 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-05-19T20:12:26.530 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-05-19T20:12:26.530 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-05-19T20:12:26.530 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-05-19T20:12:26.565 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.9 kB] 2023-05-19T20:12:26.603 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-05-19T20:12:26.608 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-05-19T20:12:26.809 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,170 kB] 2023-05-19T20:12:26.992 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [351 kB] 2023-05-19T20:12:27.007 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [12.9 kB] 2023-05-19T20:12:27.008 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-05-19T20:12:27.008 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,749 kB] 2023-05-19T20:12:27.071 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [245 kB] 2023-05-19T20:12:27.076 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-05-19T20:12:27.077 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [596 kB] 2023-05-19T20:12:27.089 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [837 kB] 2023-05-19T20:12:27.268 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [171 kB] 2023-05-19T20:12:27.674 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [17.7 kB] 2023-05-19T20:12:27.680 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-05-19T20:12:27.682 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-05-19T20:12:27.690 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-05-19T20:12:27.692 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-05-19T20:12:30.157 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 15.3 MB in 2s (6,700 kB/s) 2023-05-19T20:12:31.590 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:12:31.616 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-19T20:12:31.687 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:12:31.861 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2023-05-19T20:12:31.862 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2023-05-19T20:12:32.026 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2023-05-19T20:12:32.026 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-19T20:12:32.026 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-generic linux-image-5.4.0-148-generic 2023-05-19T20:12:32.026 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-5.4.0-148-generic linux-modules-extra-5.4.0-148-generic 2023-05-19T20:12:32.027 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2023-05-19T20:12:32.027 INFO:teuthology.orchestra.run.smithi163.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-05-19T20:12:32.027 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2023-05-19T20:12:32.027 INFO:teuthology.orchestra.run.smithi163.stdout: thermald 2023-05-19T20:12:32.076 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2023-05-19T20:12:32.076 INFO:teuthology.orchestra.run.smithi163.stdout: linux-headers-5.4.0-148 linux-headers-5.4.0-148-generic 2023-05-19T20:12:32.076 INFO:teuthology.orchestra.run.smithi163.stdout: linux-image-5.4.0-148-generic linux-modules-5.4.0-148-generic 2023-05-19T20:12:32.077 INFO:teuthology.orchestra.run.smithi163.stdout: linux-modules-extra-5.4.0-148-generic 2023-05-19T20:12:32.077 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2023-05-19T20:12:32.078 INFO:teuthology.orchestra.run.smithi163.stdout: linux-generic linux-headers-generic linux-image-generic 2023-05-19T20:12:32.259 INFO:teuthology.orchestra.run.smithi163.stdout:3 upgraded, 5 newly installed, 0 to remove and 182 not upgraded. 2023-05-19T20:12:32.259 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 77.1 MB of archives. 2023-05-19T20:12:32.260 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 380 MB of additional disk space will be used. 2023-05-19T20:12:32.260 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-148-generic amd64 5.4.0-148.165 [15.0 MB] 2023-05-19T20:12:33.435 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-148-generic amd64 5.4.0-148.165 [10.5 MB] 2023-05-19T20:12:33.710 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-148-generic amd64 5.4.0-148.165 [39.2 MB] 2023-05-19T20:12:35.010 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.148.146 [1,900 B] 2023-05-19T20:12:35.010 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.148.146 [2,496 B] 2023-05-19T20:12:35.011 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148 all 5.4.0-148.165 [11.0 MB] 2023-05-19T20:12:36.001 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-148-generic amd64 5.4.0-148.165 [1,368 kB] 2023-05-19T20:12:36.108 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.148.146 [2,372 B] 2023-05-19T20:12:36.836 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 77.1 MB in 4s (19.2 MB/s) 2023-05-19T20:12:37.052 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-5.4.0-148-generic. 2023-05-19T20:12:38.776 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-05-19T20:12:38.781 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../0-linux-modules-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-19T20:12:38.907 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:12:40.982 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-image-5.4.0-148-generic. 2023-05-19T20:12:40.996 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../1-linux-image-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-19T20:12:41.095 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:12:42.229 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-148-generic. 2023-05-19T20:12:42.245 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-19T20:12:42.301 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:12:47.371 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../3-linux-generic_5.4.0.148.146_amd64.deb ... 2023-05-19T20:12:47.498 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-19T20:12:47.893 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.148.146_amd64.deb ... 2023-05-19T20:12:48.019 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-image-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-19T20:12:48.397 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.4.0-148. 2023-05-19T20:12:48.415 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../5-linux-headers-5.4.0-148_5.4.0-148.165_all.deb ... 2023-05-19T20:12:48.455 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-19T20:12:54.244 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package linux-headers-5.4.0-148-generic. 2023-05-19T20:12:54.266 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../6-linux-headers-5.4.0-148-generic_5.4.0-148.165_amd64.deb ... 2023-05-19T20:12:54.310 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:12:57.150 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.148.146_amd64.deb ... 2023-05-19T20:12:57.272 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking linux-headers-generic (5.4.0.148.146) over (5.4.0.124.125) ... 2023-05-19T20:12:57.612 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:12:58.852 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.4.0-148 (5.4.0-148.165) ... 2023-05-19T20:12:59.011 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:13:00.147 INFO:teuthology.orchestra.run.smithi163.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-148-generic 2023-05-19T20:13:00.148 INFO:teuthology.orchestra.run.smithi163.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-148-generic 2023-05-19T20:13:00.713 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:13:02.109 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-modules-extra-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:13:03.991 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-image-generic (5.4.0.148.146) ... 2023-05-19T20:13:04.134 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-headers-generic (5.4.0.148.146) ... 2023-05-19T20:13:04.260 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up linux-generic (5.4.0.148.146) ... 2023-05-19T20:13:04.420 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for linux-image-5.4.0-148-generic (5.4.0-148.165) ... 2023-05-19T20:13:04.497 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-05-19T20:13:04.497 INFO:teuthology.orchestra.run.smithi163.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-148-generic 2023-05-19T20:13:26.459 INFO:teuthology.orchestra.run.smithi163.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-05-19T20:13:26.460 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub' 2023-05-19T20:13:26.473 INFO:teuthology.orchestra.run.smithi163.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-19T20:13:26.495 INFO:teuthology.orchestra.run.smithi163.stdout:Generating grub configuration file ... 2023-05-19T20:13:26.847 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-19T20:13:26.874 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-19T20:13:27.310 INFO:teuthology.orchestra.run.smithi163.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-19T20:13:27.322 INFO:teuthology.orchestra.run.smithi163.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-19T20:13:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:done 2023-05-19T20:13:29.627 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2023-05-19T20:13:29.675 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2023-05-19T20:13:29.675 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2023-05-19T20:13:29.675 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2023-05-19T20:13:29.675 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2023-05-19T20:13:29.675 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 19 2023-05-19T20:13:29.676 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2023-05-19T20:13:29.676 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2023-05-19T20:13:29.676 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.4.0.148.146 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2023-05-19T20:13:29.677 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2023-05-19T20:13:29.678 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2023-05-19T20:13:29.678 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-148-generic 2023-05-19T20:13:29.678 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-05-19T20:13:29.678 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-05-19T20:13:29.678 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-05-19T20:13:29.679 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2023-05-19T20:13:29.679 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get clean 2023-05-19T20:13:29.797 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2023-05-19T20:13:29.947 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-19T20:13:29.954 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-05-19T20:13:29.971 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-05-19T20:13:30.067 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-05-19T20:13:31.608 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:13:31.632 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-05-19T20:13:31.699 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:13:31.891 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2023-05-19T20:13:31.891 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2023-05-19T20:13:32.098 INFO:teuthology.orchestra.run.smithi163.stdout:linux-image-generic is already the newest version (5.4.0.148.146). 2023-05-19T20:13:32.098 INFO:teuthology.orchestra.run.smithi163.stdout:0 upgraded, 0 newly installed, 0 to remove and 182 not upgraded. 2023-05-19T20:13:32.100 DEBUG:teuthology.orchestra.run.smithi163:> dpkg -s linux-image-generic 2023-05-19T20:13:32.120 INFO:teuthology.orchestra.run.smithi163.stdout:Package: linux-image-generic 2023-05-19T20:13:32.120 INFO:teuthology.orchestra.run.smithi163.stdout:Status: install ok installed 2023-05-19T20:13:32.120 INFO:teuthology.orchestra.run.smithi163.stdout:Priority: optional 2023-05-19T20:13:32.120 INFO:teuthology.orchestra.run.smithi163.stdout:Section: kernel 2023-05-19T20:13:32.120 INFO:teuthology.orchestra.run.smithi163.stdout:Installed-Size: 19 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Maintainer: Ubuntu Kernel Team 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: amd64 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Source: linux-meta 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Version: 5.4.0.148.146 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Depends: linux-image-5.4.0-148-generic, linux-modules-extra-5.4.0-148-generic, linux-firmware, intel-microcode, amd64-microcode 2023-05-19T20:13:32.121 INFO:teuthology.orchestra.run.smithi163.stdout:Recommends: thermald 2023-05-19T20:13:32.122 INFO:teuthology.orchestra.run.smithi163.stdout:Description: Generic Linux kernel image 2023-05-19T20:13:32.122 INFO:teuthology.orchestra.run.smithi163.stdout: This package will always depend on the latest generic kernel image 2023-05-19T20:13:32.122 INFO:teuthology.orchestra.run.smithi163.stdout: available. 2023-05-19T20:13:32.122 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2023-05-19T20:13:32.126 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.Uk2ZlZO90a 2023-05-19T20:13:32.127 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Uk2ZlZO90a 2023-05-19T20:13:32.187 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.Uk2ZlZO90a 2023-05-19T20:13:32.227 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.Uk2ZlZO90a is 9KB 2023-05-19T20:13:32.242 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.Uk2ZlZO90a 2023-05-19T20:13:32.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-05-19T20:13:32.304 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:13:32.304 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-05-19T20:13:32.305 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-05-19T20:13:32.334 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-148-generic 2023-05-19T20:13:32.335 DEBUG:teuthology.orchestra.run.smithi163:> sudo update-grub 2023-05-19T20:13:33.685 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub' 2023-05-19T20:13:33.695 INFO:teuthology.orchestra.run.smithi163.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-19T20:13:33.711 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2023-05-19T20:13:33.975 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-148-generic 2023-05-19T20:13:33.987 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-148-generic 2023-05-19T20:13:34.383 INFO:teuthology.orchestra.run.smithi163.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-05-19T20:13:34.395 INFO:teuthology.orchestra.run.smithi163.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-05-19T20:13:35.171 INFO:teuthology.orchestra.run.smithi163.stderr:done 2023-05-19T20:13:35.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2023-05-19T20:14:05.204 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-19T20:14:05.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-05-19T20:14:05.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-19T20:14:23.600 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-05-19T20:14:53.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-05-19T20:14:53.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-19T20:14:56.688 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-05-19T20:15:26.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-05-19T20:15:26.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-19T20:15:42.548 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-05-19T20:15:43.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-05-19T20:15:43.353 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-148-generic"... 2023-05-19T20:15:43.353 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2023-05-19T20:15:43.359 INFO:teuthology.orchestra.run.smithi163.stdout:5.4.0-148-generic 2023-05-19T20:15:43.360 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-148-generic vs 5.4.0-148-generic 2023-05-19T20:15:43.360 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-19T20:15:43.360 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-19T20:15:44.361 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-19T20:15:44.362 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-19T20:15:44.471 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2023-05-19T20:15:44.507 DEBUG:teuthology.parallel:result is None 2023-05-19T20:15:44.508 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-19T20:15:44.516 INFO:teuthology.task.internal:Creating test directory... 2023-05-19T20:15:44.516 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-19T20:15:44.523 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-19T20:15:44.530 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-19T20:15:44.541 INFO:teuthology.task.internal:Creating archive directory... 2023-05-19T20:15:44.541 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-19T20:15:44.556 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-19T20:15:44.563 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-19T20:15:44.564 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-19T20:15:44.629 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-19T20:15:44.640 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-19T20:15:44.642 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-19T20:15:44.651 INFO:teuthology.task.internal:Configuring sudo... 2023-05-19T20:15:44.651 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-19T20:15:44.668 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-19T20:15:44.681 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-19T20:15:44.681 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-19T20:15:44.689 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-19T20:15:44.744 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-19T20:15:44.751 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:15:44.751 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-19T20:15:44.775 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2023-05-19T20:15:44.828 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-19T20:15:44.837 INFO:teuthology.task.internal:Starting timer... 2023-05-19T20:15:44.837 INFO:teuthology.run_tasks:Running task pcp... 2023-05-19T20:15:44.903 INFO:teuthology.run_tasks:Running task selinux... 2023-05-19T20:15:44.912 DEBUG:teuthology.task.selinux:Excluding smithi163: OS 'ubuntu' does not support SELinux 2023-05-19T20:15:44.913 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-19T20:15:44.913 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-19T20:15:44.913 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-19T20:15:44.913 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-19T20:15:44.922 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-19T20:15:44.928 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-19T20:15:45.060 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-19T20:15:45.079 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-19T20:15:45.081 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-19T20:21:12.869 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2023-05-19T20:21:12.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-05-19T20:21:12.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-19T20:21:12.919 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-05-19T20:21:13.037 INFO:teuthology.run_tasks:Running task clock... 2023-05-19T20:21:13.055 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-19T20:21:13.055 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-19T20:21:13.056 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-19T20:21:13.115 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-05-19T20:21:13.115 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Command line: ntpd -gq 2023-05-19T20:21:13.116 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: proto: precision = 0.088 usec (-23) 2023-05-19T20:21:13.117 INFO:teuthology.orchestra.run.smithi163.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-19T20:21:13.117 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-19T20:21:13.118 INFO:teuthology.orchestra.run.smithi163.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-19T20:21:13.118 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: restrict ::: KOD does nothing without LIMITED. 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen and drop on 0 v6wildcard [::]:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen normally on 2 lo 127.0.0.1:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen normally on 3 enp3s0f1 172.21.15.163:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen normally on 4 lo [::1]:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7d5b%5]:123 2023-05-19T20:21:13.119 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:13 ntpd[21918]: Listening on routing socket on fd #22 for interface updates 2023-05-19T20:21:14.116 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:14 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:14.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:14 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:18.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:18.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:18.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:18.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:18.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:18.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:18 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:20.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:20.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:20.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:20.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:20.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:20.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:20 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:22.116 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:22.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:22.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:22.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:22.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:22.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:22.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:22.120 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:22 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:24.116 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:24.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:24.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:24.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:24.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:24.117 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/rawstats.20230519: Permission denied 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/peerstats.20230519: Permission denied 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stdout:19 May 20:21:24 ntpd[21918]: ntpd: time slew -0.000038 s 2023-05-19T20:21:24.118 INFO:teuthology.orchestra.run.smithi163.stdout:ntpd: time slew -0.000038s 2023-05-19T20:21:24.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-19T20:21:24.119 INFO:teuthology.orchestra.run.smithi163.stderr:19 May 20:21:24 ntpd[21918]: can't open /var/log/ntpstats/loopstats.20230519: Permission denied 2023-05-19T20:21:24.193 INFO:teuthology.orchestra.run.smithi163.stdout: remote refid st t when poll reach delay offset jitter 2023-05-19T20:21:24.194 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================== 2023-05-19T20:21:24.194 INFO:teuthology.orchestra.run.smithi163.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-19T20:21:24.194 INFO:teuthology.orchestra.run.smithi163.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-19T20:21:24.194 INFO:teuthology.orchestra.run.smithi163.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-19T20:21:24.194 INFO:teuthology.orchestra.run.smithi163.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-05-19T20:21:24.195 INFO:teuthology.run_tasks:Running task install... 2023-05-19T20:21:24.205 DEBUG:teuthology.task.install:project ceph 2023-05-19T20:21:24.205 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'}} 2023-05-19T20:21:24.206 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'} 2023-05-19T20:21:24.206 INFO:teuthology.task.install:Using flavor: default 2023-05-19T20:21:24.215 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-19T20:21:24.216 INFO:teuthology.task.install:extra packages: [] 2023-05-19T20:21:24.216 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-key list | grep Ceph 2023-05-19T20:21:24.313 INFO:teuthology.orchestra.run.smithi163.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-05-19T20:21:24.373 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-19T20:21:24.373 INFO:teuthology.orchestra.run.smithi163.stdout:uid [ unknown] Ceph.com (release key) 2023-05-19T20:21:24.374 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-05-19T20:21:24.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=465d59c7325658c86eb5d8820da2d8fc49b7a1cd 2023-05-19T20:21:24.516 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default/ 2023-05-19T20:21:24.516 INFO:teuthology.task.install.deb:Package version is 17.2.6-368-g465d59c7-1focal 2023-05-19T20:21:24.627 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:21:24.628 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-19T20:21:24.644 DEBUG:teuthology.orchestra.run.smithi163:> sudo apt-get update 2023-05-19T20:21:24.825 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-05-19T20:21:24.879 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal InRelease 2023-05-19T20:21:24.900 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-05-19T20:21:24.924 INFO:teuthology.orchestra.run.smithi163.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal Release.gpg 2023-05-19T20:21:24.943 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-05-19T20:21:24.946 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-05-19T20:21:24.993 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main i386 Packages [3,376 B] 2023-05-19T20:21:25.024 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-05-19T20:21:25.106 INFO:teuthology.orchestra.run.smithi163.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-05-19T20:21:25.486 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 28.4 kB in 1s (44.8 kB/s) 2023-05-19T20:21:26.466 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:21:26.492 DEBUG:teuthology.orchestra.run.smithi163:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-368-g465d59c7-1focal cephadm=17.2.6-368-g465d59c7-1focal ceph-mds=17.2.6-368-g465d59c7-1focal ceph-mgr=17.2.6-368-g465d59c7-1focal ceph-common=17.2.6-368-g465d59c7-1focal ceph-fuse=17.2.6-368-g465d59c7-1focal ceph-test=17.2.6-368-g465d59c7-1focal ceph-volume=17.2.6-368-g465d59c7-1focal radosgw=17.2.6-368-g465d59c7-1focal python3-rados=17.2.6-368-g465d59c7-1focal python3-rgw=17.2.6-368-g465d59c7-1focal python3-cephfs=17.2.6-368-g465d59c7-1focal python3-rbd=17.2.6-368-g465d59c7-1focal libcephfs2=17.2.6-368-g465d59c7-1focal libcephfs-dev=17.2.6-368-g465d59c7-1focal librados2=17.2.6-368-g465d59c7-1focal librbd1=17.2.6-368-g465d59c7-1focal rbd-fuse=17.2.6-368-g465d59c7-1focal 2023-05-19T20:21:26.558 INFO:teuthology.orchestra.run.smithi163.stdout:Reading package lists... 2023-05-19T20:21:26.750 INFO:teuthology.orchestra.run.smithi163.stdout:Building dependency tree... 2023-05-19T20:21:26.751 INFO:teuthology.orchestra.run.smithi163.stdout:Reading state information... 2023-05-19T20:21:26.928 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages were automatically installed and are no longer required: 2023-05-19T20:21:26.929 INFO:teuthology.orchestra.run.smithi163.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-05-19T20:21:26.929 INFO:teuthology.orchestra.run.smithi163.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-19T20:21:26.929 INFO:teuthology.orchestra.run.smithi163.stdout:The following additional packages will be installed: 2023-05-19T20:21:26.929 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-19T20:21:26.930 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-05-19T20:21:26.930 INFO:teuthology.orchestra.run.smithi163.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-05-19T20:21:26.930 INFO:teuthology.orchestra.run.smithi163.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-05-19T20:21:26.930 INFO:teuthology.orchestra.run.smithi163.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-05-19T20:21:26.931 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-05-19T20:21:26.931 INFO:teuthology.orchestra.run.smithi163.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-05-19T20:21:26.931 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-05-19T20:21:26.931 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-05-19T20:21:26.931 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-05-19T20:21:26.932 INFO:teuthology.orchestra.run.smithi163.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: socat xmlstarlet 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout:Suggested packages: 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-05-19T20:21:26.933 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-05-19T20:21:26.934 INFO:teuthology.orchestra.run.smithi163.stdout:Recommended packages: 2023-05-19T20:21:26.935 INFO:teuthology.orchestra.run.smithi163.stdout: btrfs-tools 2023-05-19T20:21:27.046 INFO:teuthology.orchestra.run.smithi163.stdout:The following NEW packages will be installed: 2023-05-19T20:21:27.046 INFO:teuthology.orchestra.run.smithi163.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-05-19T20:21:27.047 INFO:teuthology.orchestra.run.smithi163.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-05-19T20:21:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-05-19T20:21:27.048 INFO:teuthology.orchestra.run.smithi163.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-05-19T20:21:27.049 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-05-19T20:21:27.050 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-05-19T20:21:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-05-19T20:21:27.051 INFO:teuthology.orchestra.run.smithi163.stdout:The following packages will be upgraded: 2023-05-19T20:21:27.051 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 librbd1 2023-05-19T20:21:27.110 INFO:teuthology.orchestra.run.smithi163.stdout:2 upgraded, 108 newly installed, 0 to remove and 164 not upgraded. 2023-05-19T20:21:27.111 INFO:teuthology.orchestra.run.smithi163.stdout:Need to get 209 MB of archives. 2023-05-19T20:21:27.111 INFO:teuthology.orchestra.run.smithi163.stdout:After this operation, 978 MB of additional disk space will be used. 2023-05-19T20:21:27.111 INFO:teuthology.orchestra.run.smithi163.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-05-19T20:21:27.194 INFO:teuthology.orchestra.run.smithi163.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-05-19T20:21:27.195 INFO:teuthology.orchestra.run.smithi163.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-368-g465d59c7-1focal [3,503 kB] 2023-05-19T20:21:27.195 INFO:teuthology.orchestra.run.smithi163.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-05-19T20:21:27.204 INFO:teuthology.orchestra.run.smithi163.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-05-19T20:21:27.210 INFO:teuthology.orchestra.run.smithi163.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-05-19T20:21:27.234 INFO:teuthology.orchestra.run.smithi163.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-05-19T20:21:27.235 INFO:teuthology.orchestra.run.smithi163.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-05-19T20:21:27.241 INFO:teuthology.orchestra.run.smithi163.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-05-19T20:21:27.273 INFO:teuthology.orchestra.run.smithi163.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-05-19T20:21:27.274 INFO:teuthology.orchestra.run.smithi163.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-05-19T20:21:27.280 INFO:teuthology.orchestra.run.smithi163.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-05-19T20:21:27.317 INFO:teuthology.orchestra.run.smithi163.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-05-19T20:21:27.370 INFO:teuthology.orchestra.run.smithi163.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-05-19T20:21:27.410 INFO:teuthology.orchestra.run.smithi163.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-05-19T20:21:27.413 INFO:teuthology.orchestra.run.smithi163.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-05-19T20:21:27.416 INFO:teuthology.orchestra.run.smithi163.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-05-19T20:21:27.428 INFO:teuthology.orchestra.run.smithi163.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-05-19T20:21:27.429 INFO:teuthology.orchestra.run.smithi163.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-05-19T20:21:27.430 INFO:teuthology.orchestra.run.smithi163.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-05-19T20:21:27.431 INFO:teuthology.orchestra.run.smithi163.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-05-19T20:21:27.432 INFO:teuthology.orchestra.run.smithi163.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-05-19T20:21:27.434 INFO:teuthology.orchestra.run.smithi163.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-19T20:21:27.469 INFO:teuthology.orchestra.run.smithi163.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-05-19T20:21:27.488 INFO:teuthology.orchestra.run.smithi163.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-05-19T20:21:27.488 INFO:teuthology.orchestra.run.smithi163.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-368-g465d59c7-1focal [3,553 kB] 2023-05-19T20:21:27.525 INFO:teuthology.orchestra.run.smithi163.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-05-19T20:21:27.532 INFO:teuthology.orchestra.run.smithi163.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-05-19T20:21:27.546 INFO:teuthology.orchestra.run.smithi163.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-05-19T20:21:27.554 INFO:teuthology.orchestra.run.smithi163.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-05-19T20:21:27.555 INFO:teuthology.orchestra.run.smithi163.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-05-19T20:21:27.579 INFO:teuthology.orchestra.run.smithi163.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-05-19T20:21:27.579 INFO:teuthology.orchestra.run.smithi163.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-05-19T20:21:27.580 INFO:teuthology.orchestra.run.smithi163.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-05-19T20:21:27.581 INFO:teuthology.orchestra.run.smithi163.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-05-19T20:21:27.617 INFO:teuthology.orchestra.run.smithi163.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-05-19T20:21:27.635 INFO:teuthology.orchestra.run.smithi163.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-368-g465d59c7-1focal [757 kB] 2023-05-19T20:21:27.656 INFO:teuthology.orchestra.run.smithi163.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-368-g465d59c7-1focal [413 kB] 2023-05-19T20:21:27.675 INFO:teuthology.orchestra.run.smithi163.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-368-g465d59c7-1focal [22.5 kB] 2023-05-19T20:21:27.676 INFO:teuthology.orchestra.run.smithi163.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-368-g465d59c7-1focal [200 kB] 2023-05-19T20:21:27.679 INFO:teuthology.orchestra.run.smithi163.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-368-g465d59c7-1focal [46.9 kB] 2023-05-19T20:21:27.680 INFO:teuthology.orchestra.run.smithi163.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-368-g465d59c7-1focal [385 kB] 2023-05-19T20:21:27.696 INFO:teuthology.orchestra.run.smithi163.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-368-g465d59c7-1focal [5,552 kB] 2023-05-19T20:21:27.704 INFO:teuthology.orchestra.run.smithi163.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-05-19T20:21:27.710 INFO:teuthology.orchestra.run.smithi163.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-19T20:21:27.711 INFO:teuthology.orchestra.run.smithi163.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-05-19T20:21:27.721 INFO:teuthology.orchestra.run.smithi163.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-05-19T20:21:27.727 INFO:teuthology.orchestra.run.smithi163.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-05-19T20:21:27.733 INFO:teuthology.orchestra.run.smithi163.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-05-19T20:21:27.734 INFO:teuthology.orchestra.run.smithi163.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-05-19T20:21:27.735 INFO:teuthology.orchestra.run.smithi163.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-05-19T20:21:27.836 INFO:teuthology.orchestra.run.smithi163.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-05-19T20:21:27.852 INFO:teuthology.orchestra.run.smithi163.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-05-19T20:21:27.887 INFO:teuthology.orchestra.run.smithi163.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-05-19T20:21:27.936 INFO:teuthology.orchestra.run.smithi163.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-368-g465d59c7-1focal [116 kB] 2023-05-19T20:21:27.939 INFO:teuthology.orchestra.run.smithi163.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-368-g465d59c7-1focal [479 kB] 2023-05-19T20:21:27.949 INFO:teuthology.orchestra.run.smithi163.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-368-g465d59c7-1focal [27.3 MB] 2023-05-19T20:21:28.033 INFO:teuthology.orchestra.run.smithi163.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-05-19T20:21:28.034 INFO:teuthology.orchestra.run.smithi163.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-05-19T20:21:28.034 INFO:teuthology.orchestra.run.smithi163.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-05-19T20:21:28.035 INFO:teuthology.orchestra.run.smithi163.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-05-19T20:21:28.037 INFO:teuthology.orchestra.run.smithi163.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-05-19T20:21:28.038 INFO:teuthology.orchestra.run.smithi163.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-05-19T20:21:28.038 INFO:teuthology.orchestra.run.smithi163.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-05-19T20:21:28.040 INFO:teuthology.orchestra.run.smithi163.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-05-19T20:21:28.041 INFO:teuthology.orchestra.run.smithi163.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-05-19T20:21:28.050 INFO:teuthology.orchestra.run.smithi163.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-05-19T20:21:28.086 INFO:teuthology.orchestra.run.smithi163.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-05-19T20:21:28.165 INFO:teuthology.orchestra.run.smithi163.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-05-19T20:21:28.176 INFO:teuthology.orchestra.run.smithi163.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-05-19T20:21:28.183 INFO:teuthology.orchestra.run.smithi163.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-05-19T20:21:28.204 INFO:teuthology.orchestra.run.smithi163.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-05-19T20:21:28.213 INFO:teuthology.orchestra.run.smithi163.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-05-19T20:21:28.246 INFO:teuthology.orchestra.run.smithi163.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-05-19T20:21:28.249 INFO:teuthology.orchestra.run.smithi163.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-05-19T20:21:28.286 INFO:teuthology.orchestra.run.smithi163.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-05-19T20:21:28.287 INFO:teuthology.orchestra.run.smithi163.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-05-19T20:21:28.287 INFO:teuthology.orchestra.run.smithi163.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-05-19T20:21:28.322 INFO:teuthology.orchestra.run.smithi163.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-05-19T20:21:28.341 INFO:teuthology.orchestra.run.smithi163.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-05-19T20:21:28.378 INFO:teuthology.orchestra.run.smithi163.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-05-19T20:21:28.448 INFO:teuthology.orchestra.run.smithi163.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-05-19T20:21:28.448 INFO:teuthology.orchestra.run.smithi163.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-19T20:21:28.448 INFO:teuthology.orchestra.run.smithi163.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-05-19T20:21:28.449 INFO:teuthology.orchestra.run.smithi163.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-05-19T20:21:28.451 INFO:teuthology.orchestra.run.smithi163.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-05-19T20:21:28.452 INFO:teuthology.orchestra.run.smithi163.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-05-19T20:21:28.452 INFO:teuthology.orchestra.run.smithi163.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-05-19T20:21:28.453 INFO:teuthology.orchestra.run.smithi163.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-05-19T20:21:28.489 INFO:teuthology.orchestra.run.smithi163.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-05-19T20:21:28.543 INFO:teuthology.orchestra.run.smithi163.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-05-19T20:21:28.870 INFO:teuthology.orchestra.run.smithi163.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-368-g465d59c7-1focal [6,445 kB] 2023-05-19T20:21:29.069 INFO:teuthology.orchestra.run.smithi163.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-368-g465d59c7-1focal [220 kB] 2023-05-19T20:21:29.070 INFO:teuthology.orchestra.run.smithi163.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-368-g465d59c7-1focal [152 kB] 2023-05-19T20:21:29.072 INFO:teuthology.orchestra.run.smithi163.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-368-g465d59c7-1focal [1,583 kB] 2023-05-19T20:21:29.083 INFO:teuthology.orchestra.run.smithi163.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-368-g465d59c7-1focal [7,829 kB] 2023-05-19T20:21:29.329 INFO:teuthology.orchestra.run.smithi163.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-368-g465d59c7-1focal [28.6 MB] 2023-05-19T20:21:30.356 INFO:teuthology.orchestra.run.smithi163.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-368-g465d59c7-1focal [3,936 B] 2023-05-19T20:21:30.437 INFO:teuthology.orchestra.run.smithi163.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-368-g465d59c7-1focal [866 kB] 2023-05-19T20:21:30.452 INFO:teuthology.orchestra.run.smithi163.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-368-g465d59c7-1focal [2,398 kB] 2023-05-19T20:21:30.468 INFO:teuthology.orchestra.run.smithi163.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-368-g465d59c7-1focal [79.1 kB] 2023-05-19T20:21:30.469 INFO:teuthology.orchestra.run.smithi163.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-368-g465d59c7-1focal [114 kB] 2023-05-19T20:21:30.470 INFO:teuthology.orchestra.run.smithi163.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-368-g465d59c7-1focal [1,757 kB] 2023-05-19T20:21:30.489 INFO:teuthology.orchestra.run.smithi163.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-368-g465d59c7-1focal [7,856 kB] 2023-05-19T20:21:30.747 INFO:teuthology.orchestra.run.smithi163.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-368-g465d59c7-1focal [4,052 B] 2023-05-19T20:21:30.748 INFO:teuthology.orchestra.run.smithi163.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-368-g465d59c7-1focal [56.1 MB] 2023-05-19T20:21:32.883 INFO:teuthology.orchestra.run.smithi163.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-368-g465d59c7-1focal [226 kB] 2023-05-19T20:21:32.888 INFO:teuthology.orchestra.run.smithi163.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-368-g465d59c7-1focal [21.8 kB] 2023-05-19T20:21:32.889 INFO:teuthology.orchestra.run.smithi163.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-368-g465d59c7-1focal [17.0 MB] 2023-05-19T20:21:33.412 INFO:teuthology.orchestra.run.smithi163.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-05-18-0754-quincy/465d59c7325658c86eb5d8820da2d8fc49b7a1cd/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-368-g465d59c7-1focal [79.5 kB] 2023-05-19T20:21:34.033 INFO:teuthology.orchestra.run.smithi163.stdout:Fetched 209 MB in 6s (32.8 MB/s) 2023-05-19T20:21:34.200 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-05-19T20:21:34.257 INFO:teuthology.orchestra.run.smithi163.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141757 files and directories currently installed.) 2023-05-19T20:21:34.261 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-05-19T20:21:34.340 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-19T20:21:34.728 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../001-librbd1_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:34.860 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librbd1 (17.2.6-368-g465d59c7-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-19T20:21:35.521 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../002-librados2_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:35.672 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librados2 (17.2.6-368-g465d59c7-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-05-19T20:21:36.368 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs2. 2023-05-19T20:21:36.387 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:36.426 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs2 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:36.745 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rados. 2023-05-19T20:21:36.761 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../004-python3-rados_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:36.795 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rados (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:37.164 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-19T20:21:37.181 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:21:37.222 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-argparse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:37.491 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cephfs. 2023-05-19T20:21:37.508 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:37.550 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cephfs (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:37.861 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-19T20:21:37.877 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:21:37.919 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-ceph-common (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:38.238 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-prettytable. 2023-05-19T20:21:38.256 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-05-19T20:21:38.297 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-05-19T20:21:38.566 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rbd. 2023-05-19T20:21:38.584 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:38.624 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rbd (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:38.960 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-05-19T20:21:38.976 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-05-19T20:21:39.018 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-19T20:21:39.372 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-05-19T20:21:39.388 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-05-19T20:21:39.463 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-05-19T20:21:39.762 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-19T20:21:39.782 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-05-19T20:21:39.812 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-19T20:21:40.199 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-19T20:21:40.216 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-05-19T20:21:40.257 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-19T20:21:40.610 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-19T20:21:40.628 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-05-19T20:21:40.668 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-19T20:21:41.105 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-19T20:21:41.121 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-19T20:21:41.173 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:21:41.784 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-19T20:21:41.803 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-19T20:21:41.842 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:21:42.229 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-19T20:21:42.245 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-05-19T20:21:42.287 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:21:42.642 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-05-19T20:21:42.658 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-05-19T20:21:42.733 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-19T20:21:43.094 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package librgw2. 2023-05-19T20:21:43.110 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../019-librgw2_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:43.152 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking librgw2 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:43.964 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rgw. 2023-05-19T20:21:43.980 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:44.022 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rgw (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:44.408 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liboath0. 2023-05-19T20:21:44.424 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-05-19T20:21:44.466 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-05-19T20:21:44.752 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libradosstriper1. 2023-05-19T20:21:44.769 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:44.802 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libradosstriper1 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:45.280 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-common. 2023-05-19T20:21:45.297 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../023-ceph-common_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:45.338 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-common (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:48.093 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-base. 2023-05-19T20:21:48.109 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../024-ceph-base_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:48.162 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-base (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:49.181 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cryptography. 2023-05-19T20:21:49.197 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-05-19T20:21:49.239 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-19T20:21:49.618 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-openssl. 2023-05-19T20:21:49.633 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-05-19T20:21:49.676 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-05-19T20:21:49.995 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-19T20:21:50.011 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:21:50.053 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-modules-core (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:50.408 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-19T20:21:50.427 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-05-19T20:21:50.457 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-19T20:21:50.768 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-19T20:21:50.785 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-05-19T20:21:50.829 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-05-19T20:21:51.193 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-natsort. 2023-05-19T20:21:51.209 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-05-19T20:21:51.251 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-05-19T20:21:51.597 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jwt. 2023-05-19T20:21:51.616 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-05-19T20:21:51.656 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-19T20:21:51.974 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-logutils. 2023-05-19T20:21:51.990 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-05-19T20:21:52.049 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-05-19T20:21:52.310 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-19T20:21:52.328 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-05-19T20:21:52.368 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-05-19T20:21:52.697 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-mako. 2023-05-19T20:21:52.715 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-05-19T20:21:52.755 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-19T20:21:53.067 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-19T20:21:53.087 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-19T20:21:53.142 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-19T20:21:53.445 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-19T20:21:53.463 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-05-19T20:21:53.503 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-05-19T20:21:53.823 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webob. 2023-05-19T20:21:53.840 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-05-19T20:21:53.882 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-05-19T20:21:54.235 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-soupsieve. 2023-05-19T20:21:54.252 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-05-19T20:21:54.294 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-19T20:21:54.580 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-bs4. 2023-05-19T20:21:54.597 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-05-19T20:21:54.639 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-05-19T20:21:55.000 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-waitress. 2023-05-19T20:21:55.019 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-05-19T20:21:55.062 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-19T20:21:55.412 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-tempita. 2023-05-19T20:21:55.428 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-05-19T20:21:55.470 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-05-19T20:21:55.774 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-paste. 2023-05-19T20:21:55.789 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-05-19T20:21:55.857 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-05-19T20:21:56.185 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-19T20:21:56.203 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-05-19T20:21:56.244 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-05-19T20:21:56.565 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-19T20:21:56.581 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-05-19T20:21:56.623 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-05-19T20:21:57.202 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webtest. 2023-05-19T20:21:57.220 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-05-19T20:21:57.677 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-05-19T20:21:57.972 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pecan. 2023-05-19T20:21:57.991 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-05-19T20:21:58.038 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-05-19T20:21:58.418 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-19T20:21:58.438 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-05-19T20:21:58.477 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-19T20:21:58.847 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-19T20:21:58.867 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:58.905 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:59.292 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr. 2023-05-19T20:21:59.308 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:59.350 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:21:59.837 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mon. 2023-05-19T20:21:59.853 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:21:59.895 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mon (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:01.050 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-osd. 2023-05-19T20:22:01.070 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:01.108 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-osd (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:03.920 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph. 2023-05-19T20:22:03.936 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../052-ceph_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:03.978 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:04.306 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-fuse. 2023-05-19T20:22:04.325 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:04.364 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-fuse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:04.809 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mds. 2023-05-19T20:22:04.825 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:04.867 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mds (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:05.420 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package cephadm. 2023-05-19T20:22:05.437 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../055-cephadm_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:05.479 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking cephadm (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:05.790 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-jinja2. 2023-05-19T20:22:05.808 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-05-19T20:22:05.865 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-05-19T20:22:06.168 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-19T20:22:06.185 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:22:06.218 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-cephadm (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:06.538 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-19T20:22:06.554 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-05-19T20:22:06.597 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-19T20:22:06.850 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjs-underscore. 2023-05-19T20:22:06.868 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-05-19T20:22:06.928 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-19T20:22:07.219 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-05-19T20:22:07.234 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-05-19T20:22:07.277 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-19T20:22:07.621 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-routes. 2023-05-19T20:22:07.638 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-05-19T20:22:07.679 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-05-19T20:22:08.058 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-19T20:22:08.078 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:22:08.116 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-dashboard (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:08.620 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-decorator. 2023-05-19T20:22:08.637 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-05-19T20:22:08.679 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-05-19T20:22:08.990 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-05-19T20:22:09.006 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-05-19T20:22:09.048 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-19T20:22:09.384 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-scipy. 2023-05-19T20:22:09.401 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-05-19T20:22:09.442 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-05-19T20:22:10.836 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-05-19T20:22:10.855 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-05-19T20:22:10.894 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-19T20:22:11.448 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-joblib. 2023-05-19T20:22:11.465 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-05-19T20:22:11.506 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-05-19T20:22:11.893 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-sklearn. 2023-05-19T20:22:11.909 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-05-19T20:22:11.951 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-19T20:22:12.652 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-19T20:22:12.669 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:22:12.710 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:13.856 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-cachetools. 2023-05-19T20:22:13.872 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-05-19T20:22:13.914 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-05-19T20:22:14.209 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-19T20:22:14.225 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-05-19T20:22:14.258 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-05-19T20:22:14.529 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-19T20:22:14.545 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-05-19T20:22:14.613 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-19T20:22:14.915 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-rsa. 2023-05-19T20:22:14.932 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-05-19T20:22:14.973 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-rsa (4.0-3) ... 2023-05-19T20:22:15.310 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-google-auth. 2023-05-19T20:22:15.328 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-05-19T20:22:15.368 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-05-19T20:22:15.713 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-blinker. 2023-05-19T20:22:15.730 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-05-19T20:22:15.771 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-19T20:22:16.058 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-oauthlib. 2023-05-19T20:22:16.074 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-05-19T20:22:16.116 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-19T20:22:16.487 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-19T20:22:16.504 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-05-19T20:22:16.545 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-19T20:22:16.873 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-websocket. 2023-05-19T20:22:16.891 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-05-19T20:22:16.931 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-05-19T20:22:17.251 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-19T20:22:17.268 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-05-19T20:22:17.333 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-05-19T20:22:17.898 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-19T20:22:17.918 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:22:17.956 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:18.603 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-19T20:22:18.623 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-05-19T20:22:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-05-19T20:22:19.040 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-19T20:22:19.057 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-19T20:22:19.098 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-19T20:22:19.376 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package jq. 2023-05-19T20:22:19.395 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-05-19T20:22:19.434 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-05-19T20:22:19.721 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package socat. 2023-05-19T20:22:19.738 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-05-19T20:22:19.779 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking socat (1.7.3.3-2) ... 2023-05-19T20:22:20.117 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package xmlstarlet. 2023-05-19T20:22:20.134 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-05-19T20:22:20.175 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-05-19T20:22:20.505 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-test. 2023-05-19T20:22:20.522 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../086-ceph-test_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:20.563 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-test (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:25.526 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package ceph-volume. 2023-05-19T20:22:25.544 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-368-g465d59c7-1focal_all.deb ... 2023-05-19T20:22:25.609 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking ceph-volume (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:25.922 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package fonts-mathjax. 2023-05-19T20:22:25.939 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-19T20:22:25.980 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-19T20:22:26.535 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-19T20:22:26.552 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:26.593 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libcephfs-dev (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:27.013 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package nvme-cli. 2023-05-19T20:22:27.029 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-05-19T20:22:27.088 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-05-19T20:22:27.460 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package libjs-mathjax. 2023-05-19T20:22:27.476 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-05-19T20:22:27.510 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-19T20:22:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python-natsort-doc. 2023-05-19T20:22:29.289 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-05-19T20:22:29.326 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-05-19T20:22:29.665 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-atomicwrites. 2023-05-19T20:22:29.684 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-05-19T20:22:29.723 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-05-19T20:22:30.051 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-attr. 2023-05-19T20:22:30.068 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-05-19T20:22:30.109 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-05-19T20:22:30.488 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-webencodings. 2023-05-19T20:22:30.504 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-05-19T20:22:30.546 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-19T20:22:30.849 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-html5lib. 2023-05-19T20:22:30.865 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-05-19T20:22:30.907 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-05-19T20:22:31.285 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-05-19T20:22:31.304 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-05-19T20:22:31.343 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-19T20:22:31.830 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-packaging. 2023-05-19T20:22:31.851 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-05-19T20:22:31.889 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-packaging (20.3-1) ... 2023-05-19T20:22:32.217 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pastescript. 2023-05-19T20:22:32.236 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-05-19T20:22:32.275 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-19T20:22:32.604 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pluggy. 2023-05-19T20:22:32.624 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-05-19T20:22:32.687 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-05-19T20:22:32.982 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-psutil. 2023-05-19T20:22:32.999 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-05-19T20:22:33.040 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-05-19T20:22:33.394 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-py. 2023-05-19T20:22:33.410 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-05-19T20:22:33.452 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-05-19T20:22:33.797 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-19T20:22:33.814 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-05-19T20:22:33.855 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-19T20:22:34.167 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-19T20:22:34.185 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-05-19T20:22:34.225 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-19T20:22:34.570 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-pytest. 2023-05-19T20:22:34.591 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-05-19T20:22:34.628 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-05-19T20:22:34.990 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package python3-simplejson. 2023-05-19T20:22:35.009 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-05-19T20:22:35.048 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-19T20:22:35.326 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-19T20:22:35.344 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-05-19T20:22:35.401 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-19T20:22:36.114 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package radosgw. 2023-05-19T20:22:36.132 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../108-radosgw_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:36.172 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking radosgw (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:37.876 INFO:teuthology.orchestra.run.smithi163.stdout:Selecting previously unselected package rbd-fuse. 2023-05-19T20:22:37.893 INFO:teuthology.orchestra.run.smithi163.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-368-g465d59c7-1focal_amd64.deb ... 2023-05-19T20:22:37.934 INFO:teuthology.orchestra.run.smithi163.stdout:Unpacking rbd-fuse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:38.260 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-attr (19.3.0-2) ... 2023-05-19T20:22:38.566 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-05-19T20:22:38.725 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-05-19T20:22:38.851 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-05-19T20:22:39.070 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up cephadm (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:39.707 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user cephadm....done 2023-05-19T20:22:39.885 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-05-19T20:22:40.020 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-05-19T20:22:40.380 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-19T20:22:40.631 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-05-19T20:22:40.757 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-05-19T20:22:40.917 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-05-19T20:22:41.243 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-05-19T20:22:41.671 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-05-19T20:22:41.989 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-05-19T20:22:42.282 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-05-19T20:22:42.567 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-05-19T20:22:42.859 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-argparse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:43.161 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-05-19T20:22:43.295 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-05-19T20:22:43.563 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-05-19T20:22:43.864 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-05-19T20:22:43.991 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-05-19T20:22:44.567 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-05-19T20:22:44.860 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-05-19T20:22:45.145 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-05-19T20:22:45.488 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-05-19T20:22:45.747 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-05-19T20:22:46.107 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-05-19T20:22:46.400 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-packaging (20.3-1) ... 2023-05-19T20:22:46.711 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-05-19T20:22:46.837 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-05-19T20:22:46.971 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-05-19T20:22:47.239 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-05-19T20:22:47.649 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-05-19T20:22:48.009 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-05-19T20:22:48.378 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up socat (1.7.3.3-2) ... 2023-05-19T20:22:48.522 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-ceph-common (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:48.815 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:22:48.950 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-05-19T20:22:49.310 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-05-19T20:22:49.667 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-05-19T20:22:49.962 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-05-19T20:22:50.255 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-05-19T20:22:50.544 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:22:50.670 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-05-19T20:22:50.805 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-05-19T20:22:51.115 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-05-19T20:22:51.416 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-05-19T20:22:51.734 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-05-19T20:22:51.885 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-19T20:22:52.170 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-05-19T20:22:52.471 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-05-19T20:22:52.756 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-05-19T20:22:53.108 INFO:teuthology.orchestra.run.smithi163.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-05-19T20:22:53.375 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-05-19T20:22:53.527 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-05-19T20:22:53.854 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-05-19T20:22:54.205 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-05-19T20:22:54.307 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-05-19T20:22:54.433 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-05-19T20:22:54.747 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-05-19T20:22:55.015 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librados2 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:55.167 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-05-19T20:22:56.651 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libsqlite3-mod-ceph (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:56.812 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-05-19T20:22:56.921 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-05-19T20:22:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-05-19T20:22:57.599 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-05-19T20:22:57.909 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-05-19T20:22:58.034 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-05-19T20:22:58.394 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs2 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:58.520 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-05-19T20:22:58.838 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libradosstriper1 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:22:58.973 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-05-19T20:22:59.290 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-05-19T20:23:00.329 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librbd1 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:00.438 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-05-19T20:23:00.581 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-05-19T20:23:00.690 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-05-19T20:23:00.816 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rsa (4.0-3) ... 2023-05-19T20:23:01.159 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-05-19T20:23:01.285 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-05-19T20:23:01.586 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-modules-core (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:01.737 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-fuse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:01.950 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-19T20:23:01.950 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-19T20:23:02.416 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up libcephfs-dev (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:02.628 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-05-19T20:23:02.937 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-19T20:23:03.247 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-05-19T20:23:03.610 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rados (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:03.737 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up librgw2 (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:03.887 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rbd (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:04.005 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up rbd-fuse (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:04.114 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-routes (2.4.1-2) ... 2023-05-19T20:23:04.399 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-05-19T20:23:04.692 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-rgw (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:04.820 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-cephfs (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:04.971 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-05-19T20:23:05.891 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-common (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:06.485 INFO:teuthology.orchestra.run.smithi163.stdout:Adding group ceph....done 2023-05-19T20:23:06.870 INFO:teuthology.orchestra.run.smithi163.stdout:Adding system user ceph....done 2023-05-19T20:23:07.046 INFO:teuthology.orchestra.run.smithi163.stdout:Setting system user ceph properties....done 2023-05-19T20:23:07.070 INFO:teuthology.orchestra.run.smithi163.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-19T20:23:07.220 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-19T20:23:07.523 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-19T20:23:08.000 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-test (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:08.126 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up radosgw (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:08.432 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-19T20:23:08.432 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-19T20:23:09.103 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-base (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:09.510 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-19T20:23:09.979 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mds (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:10.215 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-19T20:23:10.215 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-19T20:23:10.673 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:10.899 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-19T20:23:10.899 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-19T20:23:11.349 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-osd (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:11.841 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-19T20:23:11.841 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-19T20:23:12.284 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-k8sevents (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:12.410 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:12.569 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mon (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:12.785 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-19T20:23:12.786 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-19T20:23:13.237 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-cephadm (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:13.380 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:13.506 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-mgr-dashboard (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:13.657 INFO:teuthology.orchestra.run.smithi163.stdout:Setting up ceph-volume (17.2.6-368-g465d59c7-1focal) ... 2023-05-19T20:23:13.784 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-05-19T20:23:13.935 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-05-19T20:23:14.228 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-05-19T20:23:17.190 INFO:teuthology.orchestra.run.smithi163.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-05-19T20:23:17.767 INFO:teuthology.orchestra.run.smithi163.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-19T20:23:17.769 DEBUG:teuthology.parallel:result is None 2023-05-19T20:23:17.769 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=465d59c7325658c86eb5d8820da2d8fc49b7a1cd 2023-05-19T20:23:17.906 DEBUG:teuthology.orchestra.run.smithi163:> dpkg-query -W -f '${Version}' ceph 2023-05-19T20:23:17.929 INFO:teuthology.orchestra.run.smithi163.stdout:17.2.6-368-g465d59c7-1focal 2023-05-19T20:23:17.930 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-368-g465d59c7-1focal 2023-05-19T20:23:17.930 INFO:teuthology.task.install:The correct ceph version 17.2.6-368-g465d59c7-1focal is installed. 2023-05-19T20:23:17.931 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-19T20:23:17.931 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:17.932 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-19T20:23:17.985 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-19T20:23:17.986 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:17.986 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2023-05-19T20:23:18.001 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-19T20:23:18.014 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-19T20:23:18.014 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.015 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-19T20:23:18.028 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-19T20:23:18.040 INFO:teuthology.run_tasks:Running task ceph... 2023-05-19T20:23:18.122 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-19T20:23:18.123 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2023-05-19T20:23:18.139 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-19T20:23:18.139 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-19T20:23:18.148 INFO:tasks.ceph:Creating extra log directories... 2023-05-19T20:23:18.149 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-19T20:23:18.171 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-19T20:23:18.171 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 61}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-19T20:23:18.172 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi/7278510', 'branch': 'wip-yuri4-testing-2023-05-18-0754-quincy', 'description': 'rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_migration}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7278510', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-05-19_15:10:19-rbd-wip-yuri4-testing-2023-05-18-0754-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-05-18-0754-quincy'}, 'ceph': {'conf': {'client': {'rbd default features': 61}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-05-18-0754-quincy', 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 6380, 'sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'rbd', 'suite_branch': 'wip-yuri4-testing-2023-05-18-0754-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_465d59c7325658c86eb5d8820da2d8fc49b7a1cd/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '465d59c7325658c86eb5d8820da2d8fc49b7a1cd', 'targets': {'smithi163.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_migration.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-19_15:10:19', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-19T20:23:18.172 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-19T20:23:18.178 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2023-05-19T20:23:18.236 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.237 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2023-05-19T20:23:18.241 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-19T20:23:18.241 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-05-19 20:19:42.621274072 +0000 2023-05-19T20:23:18.247 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-05-19 20:19:42.337280623 +0000 2023-05-19T20:23:18.248 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-05-19 20:19:42.337280623 +0000 2023-05-19T20:23:18.248 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-05-19T20:23:18.248 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-19T20:23:18.303 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-05-19T20:23:18.304 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-05-19T20:23:18.304 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000394521 s, 1.3 MB/s 2023-05-19T20:23:18.305 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-19T20:23:18.314 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2023-05-19T20:23:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-19T20:23:18.321 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-19T20:23:18.321 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 365 Links: 1 2023-05-19T20:23:18.321 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-19T20:23:18.322 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-05-19 20:19:43.169261432 +0000 2023-05-19T20:23:18.322 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-05-19 20:19:42.881268074 +0000 2023-05-19T20:23:18.322 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-05-19 20:19:42.881268074 +0000 2023-05-19T20:23:18.322 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-05-19T20:23:18.322 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-19T20:23:18.380 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-05-19T20:23:18.380 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-05-19T20:23:18.380 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000394452 s, 1.3 MB/s 2023-05-19T20:23:18.381 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-19T20:23:18.389 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2023-05-19T20:23:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-19T20:23:18.395 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-19T20:23:18.395 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 371 Links: 1 2023-05-19T20:23:18.395 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-19T20:23:18.396 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-05-19 20:19:43.701249159 +0000 2023-05-19T20:23:18.396 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-05-19 20:19:43.437255249 +0000 2023-05-19T20:23:18.396 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-05-19 20:19:43.437255249 +0000 2023-05-19T20:23:18.396 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-05-19T20:23:18.396 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-19T20:23:18.451 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-05-19T20:23:18.451 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-05-19T20:23:18.451 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000393817 s, 1.3 MB/s 2023-05-19T20:23:18.452 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-19T20:23:18.459 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2023-05-19T20:23:18.464 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2023-05-19 20:19:44.233236888 +0000 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2023-05-19 20:19:43.953243347 +0000 2023-05-19T20:23:18.465 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2023-05-19 20:19:43.953243347 +0000 2023-05-19T20:23:18.466 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: - 2023-05-19T20:23:18.466 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-19T20:23:18.476 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2023-05-19T20:23:18.476 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2023-05-19T20:23:18.476 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.00041998 s, 1.2 MB/s 2023-05-19T20:23:18.477 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-19T20:23:18.529 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-05-19T20:23:18.530 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-05-19T20:23:18.530 INFO:tasks.ceph:Generating config... 2023-05-19T20:23:18.532 INFO:tasks.ceph:[client] rbd default features = 61 2023-05-19T20:23:18.532 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-05-19T20:23:18.532 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-05-19T20:23:18.532 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-19T20:23:18.533 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-19T20:23:18.533 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-19T20:23:18.533 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-19T20:23:18.534 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-19T20:23:18.534 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-19T20:23:18.534 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2023-05-19T20:23:18.534 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-05-19T20:23:18.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-19T20:23:18.535 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-19T20:23:18.535 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-19T20:23:18.535 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-19T20:23:18.536 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-19T20:23:18.536 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-19T20:23:18.536 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-19T20:23:18.536 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-19T20:23:18.536 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-19T20:23:18.537 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-19T20:23:18.537 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-19T20:23:18.537 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-05-19T20:23:18.537 INFO:tasks.ceph:Setting up mon.a... 2023-05-19T20:23:18.538 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-19T20:23:18.571 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.keyring 2023-05-19T20:23:18.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-19T20:23:18.607 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-19T20:23:18.621 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.163')] 2023-05-19T20:23:18.622 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.163', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 61}, 'mon.a': {}} 2023-05-19T20:23:18.623 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.623 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-19T20:23:18.628 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.163 --print /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:18.660 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:18.660 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: generated fsid b5723d43-725c-42eb-8257-ff58b4f2852c 2023-05-19T20:23:18.660 INFO:teuthology.orchestra.run.smithi163.stdout:setting min_mon_release = octopus 2023-05-19T20:23:18.660 INFO:teuthology.orchestra.run.smithi163.stdout:epoch 0 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:fsid b5723d43-725c-42eb-8257-ff58b4f2852c 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:last_changed 2023-05-19T20:23:18.653368+0000 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:created 2023-05-19T20:23:18.653368+0000 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:min_mon_release 15 (octopus) 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:election_strategy: 1 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:0: [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] mon.a 2023-05-19T20:23:18.661 INFO:teuthology.orchestra.run.smithi163.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-05-19T20:23:18.662 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-19T20:23:18.711 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b5723d43-725c-42eb-8257-ff58b4f2852c... 2023-05-19T20:23:18.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-19T20:23:18.748 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2023-05-19T20:23:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2023-05-19T20:23:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-19T20:23:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2023-05-19T20:23:18.748 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2023-05-19T20:23:18.749 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2023-05-19T20:23:18.750 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2023-05-19T20:23:18.751 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2023-05-19T20:23:18.752 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2023-05-19T20:23:18.753 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = 172.21.15.163 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: mon client directed command retry = 5 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: ms inject socket failures = 5000 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = b5723d43-725c-42eb-8257-ff58b4f2852c 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2023-05-19T20:23:18.754 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.755 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.756 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2023-05-19T20:23:18.757 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore block size = 96636764160 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression algorithm = zlib 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore compression mode = aggressive 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: bluestore fsck on mount = True 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluefs = 1/20 2023-05-19T20:23:18.758 INFO:teuthology.orchestra.run.smithi163.stdout: debug bluestore = 1/20 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: debug rocksdb = 4/10 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd backfillfull_ratio = 0.85 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd full ratio = 0.9 2023-05-19T20:23:18.759 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd nearfull ratio = 0.8 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: osd failsafe full ratio = 0.95 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: osd objectstore = bluestore 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: osd shutdown pgref assert = True 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-05-19T20:23:18.760 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2023-05-19T20:23:18.761 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2023-05-19T20:23:18.762 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.763 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2023-05-19T20:23:18.764 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout: rbd default features = 61 2023-05-19T20:23:18.765 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2023-05-19T20:23:18.766 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-19T20:23:18.767 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-19T20:23:18.817 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-19T20:23:18.818 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.818 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-19T20:23:18.823 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.823 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-19T20:23:18.829 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:23:18.829 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.829 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-19T20:23:18.829 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-19T20:23:18.852 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:18.853 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:18.858 INFO:tasks.ceph:Setting up mon nodes... 2023-05-19T20:23:18.858 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-19T20:23:18.858 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-19T20:23:18.944 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-19T20:23:18.946 INFO:tasks.ceph:Setting up mds nodes... 2023-05-19T20:23:18.947 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-19T20:23:18.947 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-19T20:23:18.980 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-19T20:23:18.993 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-19T20:23:18.993 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-05-19T20:23:18.993 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-19T20:23:19.005 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-05-19T20:23:19.005 INFO:tasks.ceph:role: osd.0 2023-05-19T20:23:19.005 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:23:19.006 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-19T20:23:19.548 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-19T20:23:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-19T20:23:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-19T20:23:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-05-19T20:23:19.549 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-19T20:23:19.549 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-05-19T20:23:19.550 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-19T20:23:19.550 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-19T20:23:19.550 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-19T20:23:19.550 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-19T20:23:19.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-05-19T20:23:19.551 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-19T20:23:19.648 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-19T20:23:19.659 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2023-05-19T20:23:19.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-19T20:23:19.661 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-19T20:23:19.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-05-19T20:23:19.671 INFO:tasks.ceph:role: osd.1 2023-05-19T20:23:19.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:23:19.671 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-19T20:23:20.169 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-19T20:23:20.169 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-19T20:23:20.170 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-19T20:23:20.171 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-19T20:23:20.172 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-05-19T20:23:20.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-19T20:23:20.216 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-19T20:23:20.268 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2023-05-19T20:23:20.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-19T20:23:20.270 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-19T20:23:20.279 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-05-19T20:23:20.280 INFO:tasks.ceph:role: osd.2 2023-05-19T20:23:20.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:23:20.280 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-19T20:23:20.761 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-19T20:23:20.761 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-19T20:23:20.762 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-19T20:23:20.763 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-19T20:23:20.763 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2023-05-19T20:23:20.764 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-19T20:23:20.808 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-19T20:23:20.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-19T20:23:20.821 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: /sbin/restorecon: command not found 2023-05-19T20:23:20.821 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:20.933 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.920+0000 7ff36f56f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-19T20:23:20.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.924+0000 7ff36f56f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-19T20:23:20.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.924+0000 7ff36f56f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-19T20:23:20.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.924+0000 7ff36f56f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-19T20:23:20.935 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.924+0000 7ff36f56f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-19T20:23:20.941 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:20.932+0000 7ff36f56f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-19T20:23:21.508 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:21.496+0000 7ff36f56f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:22.283 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:22.272+0000 7ff36f56f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:23.070 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.060+0000 7ff36f56f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:23.942 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-19T20:23:23.957 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:23.993 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.980+0000 7f114522d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-19T20:23:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.984+0000 7f114522d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-19T20:23:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.984+0000 7f114522d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-19T20:23:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.984+0000 7f114522d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-19T20:23:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.984+0000 7f114522d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-19T20:23:23.994 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:23.984+0000 7f114522d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-19T20:23:24.547 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:24.536+0000 7f114522d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:25.334 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:25.324+0000 7f114522d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:26.116 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:26.104+0000 7f114522d3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:26.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-19T20:23:26.983 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:27.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-19T20:23:27.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-19T20:23:27.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-19T20:23:27.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-19T20:23:27.023 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-19T20:23:27.024 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.012+0000 7f6b23f1e3c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-19T20:23:27.585 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:27.572+0000 7f6b23f1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:28.365 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:28.356+0000 7f6b23f1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:29.143 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:29.132+0000 7f6b23f1e3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-05-19T20:23:30.021 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-19T20:23:30.037 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-19T20:23:30.037 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.038 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-19T20:23:30.096 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.097 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-19T20:23:30.107 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.108 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-19T20:23:30.119 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.120 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-19T20:23:30.176 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.177 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-19T20:23:30.182 INFO:tasks.ceph:Adding keys to all mons... 2023-05-19T20:23:30.182 DEBUG:teuthology.orchestra.run.smithi163:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-19T20:23:30.195 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr.x] 2023-05-19T20:23:30.195 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC22mdkCGHnNxAAQFtBNLtmLQOcBRly2c9OPQ== 2023-05-19T20:23:30.195 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC42mdkxbM8NxAAi4R3W1j64EG79T5es4vSeg== 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC72mdkQz7NOhAA5Ns0u9g1eGm0kvkTokmnPQ== 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC/2mdkMYL1ABAAGGpuRCakY29Bil4NFTGr2Q== 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2023-05-19T20:23:30.196 INFO:teuthology.orchestra.run.smithi163.stdout: key = AQC22mdkB8ALOhAAXyvHRX7KV9RO0tkDNIDdZA== 2023-05-19T20:23:30.197 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-19T20:23:30.283 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-19T20:23:30.324 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-19T20:23:30.364 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-19T20:23:30.405 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-19T20:23:30.446 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-19T20:23:30.446 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-19T20:23:30.456 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-19T20:23:30.554 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-19T20:23:30.567 DEBUG:teuthology.orchestra.run.smithi163:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-19T20:23:30.573 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-19T20:23:30.574 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-19T20:23:30.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-19T20:23:30.618 INFO:tasks.ceph.mon.a:Started 2023-05-19T20:23:30.619 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-19T20:23:30.619 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-19T20:23:30.619 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-19T20:23:30.621 INFO:tasks.ceph.mgr.x:Started 2023-05-19T20:23:30.622 INFO:tasks.ceph:Setting crush tunables to default 2023-05-19T20:23:30.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd crush tunables default 2023-05-19T20:23:30.823 INFO:teuthology.orchestra.run.smithi163.stderr:adjusted tunables profile to default 2023-05-19T20:23:30.832 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-19T20:23:30.833 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.833 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-19T20:23:30.843 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.844 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-19T20:23:30.854 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:23:30.854 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-19T20:23:30.868 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new cdadae04-0af1-4897-8d8d-ef56bb64166c 0 2023-05-19T20:23:30.918 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:30.907+0000 7f23844dd000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-19T20:23:31.057 INFO:teuthology.orchestra.run.smithi163.stdout:0 2023-05-19T20:23:31.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new eb4aaa1b-a4b0-49e3-8b78-e88203990025 1 2023-05-19T20:23:31.261 INFO:teuthology.orchestra.run.smithi163.stdout:1 2023-05-19T20:23:31.274 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd new 938cd4a1-3bf1-4b55-8a65-7820321e989e 2 2023-05-19T20:23:31.463 INFO:teuthology.orchestra.run.smithi163.stdout:2 2023-05-19T20:23:31.475 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-19T20:23:31.476 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-19T20:23:31.477 INFO:tasks.ceph.osd.0:Started 2023-05-19T20:23:31.478 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-19T20:23:31.478 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-19T20:23:31.479 INFO:tasks.ceph.osd.1:Started 2023-05-19T20:23:31.480 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-19T20:23:31.480 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-19T20:23:31.481 INFO:tasks.ceph.osd.2:Started 2023-05-19T20:23:31.482 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:31.662 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:31.651+0000 7f23844dd000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-19T20:23:31.718 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:31.707+0000 7f23844dd000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-19T20:23:31.781 INFO:teuthology.orchestra.run.smithi163.stderr:2023-05-19T20:23:31.771+0000 7f3d19e2b700 0 --2- 172.21.15.163:0/3159677122 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f3d14119600 0x7f3d14132440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-05-19T20:23:31.833 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:31.823+0000 7f23844dd000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-19T20:23:31.855 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-05-19T20:23:31.843+0000 7f88787f63c0 -1 Falling back to public interface 2023-05-19T20:23:31.861 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:31.861 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":5,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:31.453588+0000","last_up_change":"0.000000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:31.877 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-19T20:23:31.877 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-19T20:23:32.059 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.047+0000 7f23844dd000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-19T20:23:32.106 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.095+0000 7f23844dd000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-19T20:23:32.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:23:32.099+0000 7fa5ccec63c0 -1 Falling back to public interface 2023-05-19T20:23:32.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:23:32.115+0000 7eff8657a3c0 -1 Falling back to public interface 2023-05-19T20:23:32.179 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:32.282 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.271+0000 7f23844dd000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-19T20:23:32.352 INFO:teuthology.misc.health.smithi163.stdout: 2023-05-19T20:23:32.352 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":5,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:31.453588+0000","last_up_change":"0.000000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:32.358 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.347+0000 7f23844dd000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-19T20:23:32.362 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-05-19T20:23:32.423 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.411+0000 7f23844dd000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-19T20:23:32.858 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.847+0000 7f23844dd000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-19T20:23:32.979 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:32.967+0000 7f23844dd000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-19T20:23:33.288 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.275+0000 7f23844dd000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-19T20:23:33.452 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.439+0000 7f23844dd000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-19T20:23:33.517 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.503+0000 7f23844dd000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-19T20:23:33.569 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.559+0000 7f23844dd000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-19T20:23:33.625 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.611+0000 7f23844dd000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-19T20:23:33.893 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.879+0000 7f23844dd000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-19T20:23:33.948 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:33.935+0000 7f23844dd000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-19T20:23:34.013 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:34.003+0000 7f23844dd000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-19T20:23:34.171 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:34.159+0000 7f23844dd000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-19T20:23:34.237 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:34.227+0000 7f23844dd000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-19T20:23:34.976 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:34.963+0000 7f23844dd000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-19T20:23:35.731 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-05-19T20:23:35.719+0000 7f88787f63c0 -1 osd.2 0 log_to_monitors true 2023-05-19T20:23:35.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:23:35.735+0000 7eff8657a3c0 -1 osd.1 0 log_to_monitors true 2023-05-19T20:23:35.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:23:35.919+0000 7fa5ccec63c0 -1 osd.0 0 log_to_monitors true 2023-05-19T20:23:36.009 INFO:tasks.ceph.mgr.x.smithi163.stderr:2023-05-19T20:23:35.995+0000 7f236d5d7700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-05-19T20:23:38.665 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:38.925 INFO:teuthology.misc.health.smithi163.stdout: 2023-05-19T20:23:38.925 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":7,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:37.696760+0000","last_up_change":"0.000000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:38.935 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-05-19T20:23:40.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:23:40.911+0000 7fa5c9e8b700 -1 osd.0 0 waiting for initial osdmap 2023-05-19T20:23:40.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:23:40.915+0000 7fa5c140a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-19T20:23:40.951 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-05-19T20:23:40.939+0000 7f88757bb700 -1 osd.2 0 waiting for initial osdmap 2023-05-19T20:23:40.958 INFO:tasks.ceph.osd.2.smithi163.stderr:2023-05-19T20:23:40.947+0000 7f886cd3a700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-19T20:23:40.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:23:40.963+0000 7eff8353f700 -1 osd.1 0 waiting for initial osdmap 2023-05-19T20:23:40.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:23:40.967+0000 7eff7aabe700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-19T20:23:45.238 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:45.524 INFO:teuthology.misc.health.smithi163.stdout: 2023-05-19T20:23:45.525 INFO:teuthology.misc.health.smithi163.stdout:{"epoch":11,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:44.924308+0000","last_up_change":"2023-05-19T20:23:41.915981+0000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-19T20:23:43.060606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":29215},{"type":"v1","addr":"172.21.15.163:6809","nonce":29215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":29215},{"type":"v1","addr":"172.21.15.163:6811","nonce":29215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":29215},{"type":"v1","addr":"172.21.15.163:6815","nonce":29215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":29215},{"type":"v1","addr":"172.21.15.163:6813","nonce":29215}]},"public_addr":"172.21.15.163:6809/29215","cluster_addr":"172.21.15.163:6811/29215","heartbeat_back_addr":"172.21.15.163:6815/29215","heartbeat_front_addr":"172.21.15.163:6813/29215","state":["exists","up"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":29216},{"type":"v1","addr":"172.21.15.163:6817","nonce":29216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":29216},{"type":"v1","addr":"172.21.15.163:6819","nonce":29216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":29216},{"type":"v1","addr":"172.21.15.163:6823","nonce":29216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":29216},{"type":"v1","addr":"172.21.15.163:6821","nonce":29216}]},"public_addr":"172.21.15.163:6817/29216","cluster_addr":"172.21.15.163:6819/29216","heartbeat_back_addr":"172.21.15.163:6823/29216","heartbeat_front_addr":"172.21.15.163:6821/29216","state":["exists","up"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":29214},{"type":"v1","addr":"172.21.15.163:6801","nonce":29214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":29214},{"type":"v1","addr":"172.21.15.163:6803","nonce":29214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":29214},{"type":"v1","addr":"172.21.15.163:6807","nonce":29214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":29214},{"type":"v1","addr":"172.21.15.163:6805","nonce":29214}]},"public_addr":"172.21.15.163:6801/29214","cluster_addr":"172.21.15.163:6803/29214","heartbeat_back_addr":"172.21.15.163:6807/29214","heartbeat_front_addr":"172.21.15.163:6805/29214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.944375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.781429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.760113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:45.533 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-05-19T20:23:45.534 INFO:tasks.ceph:Creating RBD pool 2023-05-19T20:23:45.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-19T20:23:45.954 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'rbd' created 2023-05-19T20:23:45.965 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-19T20:23:46.958 INFO:teuthology.orchestra.run.smithi163.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-19T20:23:46.969 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-19T20:23:46.969 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-19T20:23:46.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-19T20:23:46.970 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-19T20:23:46.970 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-19T20:23:47.279 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:47.292 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":29031},{"type":"v1","addr":"172.21.15.163:6825","nonce":29031}]},"active_addr":"172.21.15.163:6825/29031","active_change":"2023-05-19T20:23:34.988317+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1411290862}]},{"addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":888804060}]},{"addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":3358114691}]}]} 2023-05-19T20:23:47.295 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-19T20:23:47.295 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-19T20:23:47.296 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:47.578 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:47.578 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":13,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:46.932564+0000","last_up_change":"2023-05-19T20:23:41.915981+0000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-19T20:23:43.060606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-19T20:23:45.855145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":29215},{"type":"v1","addr":"172.21.15.163:6809","nonce":29215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":29215},{"type":"v1","addr":"172.21.15.163:6811","nonce":29215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":29215},{"type":"v1","addr":"172.21.15.163:6815","nonce":29215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":29215},{"type":"v1","addr":"172.21.15.163:6813","nonce":29215}]},"public_addr":"172.21.15.163:6809/29215","cluster_addr":"172.21.15.163:6811/29215","heartbeat_back_addr":"172.21.15.163:6815/29215","heartbeat_front_addr":"172.21.15.163:6813/29215","state":["exists","up"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":29216},{"type":"v1","addr":"172.21.15.163:6817","nonce":29216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":29216},{"type":"v1","addr":"172.21.15.163:6819","nonce":29216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":29216},{"type":"v1","addr":"172.21.15.163:6823","nonce":29216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":29216},{"type":"v1","addr":"172.21.15.163:6821","nonce":29216}]},"public_addr":"172.21.15.163:6817/29216","cluster_addr":"172.21.15.163:6819/29216","heartbeat_back_addr":"172.21.15.163:6823/29216","heartbeat_front_addr":"172.21.15.163:6821/29216","state":["exists","up"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":29214},{"type":"v1","addr":"172.21.15.163:6801","nonce":29214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":29214},{"type":"v1","addr":"172.21.15.163:6803","nonce":29214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":29214},{"type":"v1","addr":"172.21.15.163:6807","nonce":29214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":29214},{"type":"v1","addr":"172.21.15.163:6805","nonce":29214}]},"public_addr":"172.21.15.163:6801/29214","cluster_addr":"172.21.15.163:6803/29214","heartbeat_back_addr":"172.21.15.163:6807/29214","heartbeat_front_addr":"172.21.15.163:6805/29214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.944375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.781429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.760113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:47.592 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-19T20:23:47.592 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-19T20:23:47.871 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:47.871 INFO:teuthology.orchestra.run.smithi163.stdout:{"epoch":13,"fsid":"b5723d43-725c-42eb-8257-ff58b4f2852c","created":"2023-05-19T20:23:30.718085+0000","modified":"2023-05-19T20:23:46.932564+0000","last_up_change":"2023-05-19T20:23:41.915981+0000","last_in_change":"2023-05-19T20:23:31.453588+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-19T20:23:43.060606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-19T20:23:45.855145+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"cdadae04-0af1-4897-8d8d-ef56bb64166c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":29215},{"type":"v1","addr":"172.21.15.163:6809","nonce":29215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":29215},{"type":"v1","addr":"172.21.15.163:6811","nonce":29215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":29215},{"type":"v1","addr":"172.21.15.163:6815","nonce":29215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6812","nonce":29215},{"type":"v1","addr":"172.21.15.163:6813","nonce":29215}]},"public_addr":"172.21.15.163:6809/29215","cluster_addr":"172.21.15.163:6811/29215","heartbeat_back_addr":"172.21.15.163:6815/29215","heartbeat_front_addr":"172.21.15.163:6813/29215","state":["exists","up"]},{"osd":1,"uuid":"eb4aaa1b-a4b0-49e3-8b78-e88203990025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6816","nonce":29216},{"type":"v1","addr":"172.21.15.163:6817","nonce":29216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":29216},{"type":"v1","addr":"172.21.15.163:6819","nonce":29216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":29216},{"type":"v1","addr":"172.21.15.163:6823","nonce":29216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6820","nonce":29216},{"type":"v1","addr":"172.21.15.163:6821","nonce":29216}]},"public_addr":"172.21.15.163:6817/29216","cluster_addr":"172.21.15.163:6819/29216","heartbeat_back_addr":"172.21.15.163:6823/29216","heartbeat_front_addr":"172.21.15.163:6821/29216","state":["exists","up"]},{"osd":2,"uuid":"938cd4a1-3bf1-4b55-8a65-7820321e989e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":29214},{"type":"v1","addr":"172.21.15.163:6801","nonce":29214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":29214},{"type":"v1","addr":"172.21.15.163:6803","nonce":29214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":29214},{"type":"v1","addr":"172.21.15.163:6807","nonce":29214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":29214},{"type":"v1","addr":"172.21.15.163:6805","nonce":29214}]},"public_addr":"172.21.15.163:6801/29214","cluster_addr":"172.21.15.163:6803/29214","heartbeat_back_addr":"172.21.15.163:6807/29214","heartbeat_front_addr":"172.21.15.163:6805/29214","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.944375+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.781429+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-05-19T20:23:36.760113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-19T20:23:47.886 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-19T20:23:47.886 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-19T20:23:47.887 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-19T20:23:48.019 INFO:teuthology.orchestra.run.smithi163.stdout:34359738375 2023-05-19T20:23:48.020 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-19T20:23:48.031 INFO:teuthology.orchestra.run.smithi163.stdout:34359738372 2023-05-19T20:23:48.031 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-19T20:23:48.033 INFO:teuthology.orchestra.run.smithi163.stdout:34359738373 2023-05-19T20:23:48.033 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-19T20:23:48.287 INFO:teuthology.orchestra.run.smithi163.stdout:34359738373 2023-05-19T20:23:48.301 INFO:teuthology.orchestra.run.smithi163.stdout:34359738371 2023-05-19T20:23:48.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.2 2023-05-19T20:23:48.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738371 for osd.1 2023-05-19T20:23:48.314 INFO:teuthology.orchestra.run.smithi163.stdout:34359738370 2023-05-19T20:23:48.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.0 2023-05-19T20:23:49.307 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-19T20:23:49.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-19T20:23:49.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-19T20:23:49.600 INFO:teuthology.orchestra.run.smithi163.stdout:34359738371 2023-05-19T20:23:49.602 INFO:teuthology.orchestra.run.smithi163.stdout:34359738373 2023-05-19T20:23:49.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738371 for osd.1 2023-05-19T20:23:49.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738373 for osd.2 2023-05-19T20:23:49.640 INFO:teuthology.orchestra.run.smithi163.stdout:34359738370 2023-05-19T20:23:49.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738370 for osd.0 2023-05-19T20:23:50.615 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-19T20:23:50.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-19T20:23:50.654 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-19T20:23:50.914 INFO:teuthology.orchestra.run.smithi163.stdout:34359738373 2023-05-19T20:23:50.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738373 got 34359738373 for osd.1 2023-05-19T20:23:50.932 DEBUG:teuthology.parallel:result is None 2023-05-19T20:23:50.945 INFO:teuthology.orchestra.run.smithi163.stdout:34359738375 2023-05-19T20:23:50.956 INFO:teuthology.orchestra.run.smithi163.stdout:34359738372 2023-05-19T20:23:50.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.2 2023-05-19T20:23:50.964 DEBUG:teuthology.parallel:result is None 2023-05-19T20:23:50.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2023-05-19T20:23:50.968 DEBUG:teuthology.parallel:result is None 2023-05-19T20:23:50.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-19T20:23:50.969 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-19T20:23:51.236 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:51.240 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-05-19T20:23:51.249 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-05-19T20:23:50.998863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25300,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":283090220,"statfs":{"total":289910292480,"available":289884385280,"internally_reserved":0,"allocated":454656,"data_stored":1272095,"data_compressed":7208,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.051984"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.952461+0000","last_change":"2023-05-19T20:23:46.952461+0000","last_active":"2023-05-19T20:23:46.952461+0000","last_peered":"2023-05-19T20:23:46.952461+0000","last_clean":"2023-05-19T20:23:46.952461+0000","last_became_active":"2023-05-19T20:23:46.951734+0000","last_became_peered":"2023-05-19T20:23:46.951734+0000","last_unstale":"2023-05-19T20:23:46.952461+0000","last_undegraded":"2023-05-19T20:23:46.952461+0000","last_fullsized":"2023-05-19T20:23:46.952461+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T02:13:43.602298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951628+0000","last_change":"2023-05-19T20:23:46.951628+0000","last_active":"2023-05-19T20:23:46.951628+0000","last_peered":"2023-05-19T20:23:46.951628+0000","last_clean":"2023-05-19T20:23:46.951628+0000","last_became_active":"2023-05-19T20:23:46.951093+0000","last_became_peered":"2023-05-19T20:23:46.951093+0000","last_unstale":"2023-05-19T20:23:46.951628+0000","last_undegraded":"2023-05-19T20:23:46.951628+0000","last_fullsized":"2023-05-19T20:23:46.951628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T08:04:32.501153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951907+0000","last_change":"2023-05-19T20:23:46.951907+0000","last_active":"2023-05-19T20:23:46.951907+0000","last_peered":"2023-05-19T20:23:46.951907+0000","last_clean":"2023-05-19T20:23:46.951907+0000","last_became_active":"2023-05-19T20:23:46.951476+0000","last_became_peered":"2023-05-19T20:23:46.951476+0000","last_unstale":"2023-05-19T20:23:46.951907+0000","last_undegraded":"2023-05-19T20:23:46.951907+0000","last_fullsized":"2023-05-19T20:23:46.951907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T03:39:50.221953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951508+0000","last_change":"2023-05-19T20:23:46.951508+0000","last_active":"2023-05-19T20:23:46.951508+0000","last_peered":"2023-05-19T20:23:46.951508+0000","last_clean":"2023-05-19T20:23:46.951508+0000","last_became_active":"2023-05-19T20:23:46.951144+0000","last_became_peered":"2023-05-19T20:23:46.951144+0000","last_unstale":"2023-05-19T20:23:46.951508+0000","last_undegraded":"2023-05-19T20:23:46.951508+0000","last_fullsized":"2023-05-19T20:23:46.951508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-20T23:36:08.350622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.948263+0000","last_change":"2023-05-19T20:23:46.948263+0000","last_active":"2023-05-19T20:23:46.948263+0000","last_peered":"2023-05-19T20:23:46.948263+0000","last_clean":"2023-05-19T20:23:46.948263+0000","last_became_active":"2023-05-19T20:23:46.947653+0000","last_became_peered":"2023-05-19T20:23:46.947653+0000","last_unstale":"2023-05-19T20:23:46.948263+0000","last_undegraded":"2023-05-19T20:23:46.948263+0000","last_fullsized":"2023-05-19T20:23:46.948263+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-20T21:45:01.888408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.948894+0000","last_change":"2023-05-19T20:23:46.947170+0000","last_active":"2023-05-19T20:23:46.948894+0000","last_peered":"2023-05-19T20:23:46.948894+0000","last_clean":"2023-05-19T20:23:46.948894+0000","last_became_active":"2023-05-19T20:23:46.946646+0000","last_became_peered":"2023-05-19T20:23:46.946646+0000","last_unstale":"2023-05-19T20:23:46.948894+0000","last_undegraded":"2023-05-19T20:23:46.948894+0000","last_fullsized":"2023-05-19T20:23:46.948894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T04:00:56.271695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.949848+0000","last_change":"2023-05-19T20:23:46.948235+0000","last_active":"2023-05-19T20:23:46.949848+0000","last_peered":"2023-05-19T20:23:46.949848+0000","last_clean":"2023-05-19T20:23:46.949848+0000","last_became_active":"2023-05-19T20:23:46.947668+0000","last_became_peered":"2023-05-19T20:23:46.947668+0000","last_unstale":"2023-05-19T20:23:46.949848+0000","last_undegraded":"2023-05-19T20:23:46.949848+0000","last_fullsized":"2023-05-19T20:23:46.949848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T00:34:27.058141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.949490+0000","last_change":"2023-05-19T20:23:46.949490+0000","last_active":"2023-05-19T20:23:46.949490+0000","last_peered":"2023-05-19T20:23:46.949490+0000","last_clean":"2023-05-19T20:23:46.949490+0000","last_became_active":"2023-05-19T20:23:46.948602+0000","last_became_peered":"2023-05-19T20:23:46.948602+0000","last_unstale":"2023-05-19T20:23:46.949490+0000","last_undegraded":"2023-05-19T20:23:46.949490+0000","last_fullsized":"2023-05-19T20:23:46.949490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T05:08:44.103002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":137,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-05-19T20:23:45.945322+0000","last_change":"2023-05-19T20:23:44.940319+0000","last_active":"2023-05-19T20:23:45.945322+0000","last_peered":"2023-05-19T20:23:45.945322+0000","last_clean":"2023-05-19T20:23:45.945322+0000","last_became_active":"2023-05-19T20:23:44.938128+0000","last_became_peered":"2023-05-19T20:23:44.938128+0000","last_unstale":"2023-05-19T20:23:45.945322+0000","last_undegraded":"2023-05-19T20:23:45.945322+0000","last_fullsized":"2023-05-19T20:23:45.945322+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:43.919549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:43.919549+0000","last_clean_scrub_stamp":"2023-05-19T20:23:43.919549+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T02:24:31.621412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7208,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8120,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363720,"statfs":{"total":96636764160,"available":96628449280,"internally_reserved":0,"allocated":114688,"data_stored":30769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":167936,"data_stored":620189,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8560,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363280,"statfs":{"total":96636764160,"available":96627998720,"internally_reserved":0,"allocated":172032,"data_stored":621137,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-19T20:23:51.251 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-19T20:23:51.529 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:51.532 INFO:teuthology.orchestra.run.smithi163.stderr:dumped all 2023-05-19T20:23:51.542 INFO:teuthology.orchestra.run.smithi163.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-05-19T20:23:50.998863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25300,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":283090220,"statfs":{"total":289910292480,"available":289884385280,"internally_reserved":0,"allocated":454656,"data_stored":1272095,"data_compressed":7208,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.051984"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.952461+0000","last_change":"2023-05-19T20:23:46.952461+0000","last_active":"2023-05-19T20:23:46.952461+0000","last_peered":"2023-05-19T20:23:46.952461+0000","last_clean":"2023-05-19T20:23:46.952461+0000","last_became_active":"2023-05-19T20:23:46.951734+0000","last_became_peered":"2023-05-19T20:23:46.951734+0000","last_unstale":"2023-05-19T20:23:46.952461+0000","last_undegraded":"2023-05-19T20:23:46.952461+0000","last_fullsized":"2023-05-19T20:23:46.952461+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T02:13:43.602298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951628+0000","last_change":"2023-05-19T20:23:46.951628+0000","last_active":"2023-05-19T20:23:46.951628+0000","last_peered":"2023-05-19T20:23:46.951628+0000","last_clean":"2023-05-19T20:23:46.951628+0000","last_became_active":"2023-05-19T20:23:46.951093+0000","last_became_peered":"2023-05-19T20:23:46.951093+0000","last_unstale":"2023-05-19T20:23:46.951628+0000","last_undegraded":"2023-05-19T20:23:46.951628+0000","last_fullsized":"2023-05-19T20:23:46.951628+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T08:04:32.501153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951907+0000","last_change":"2023-05-19T20:23:46.951907+0000","last_active":"2023-05-19T20:23:46.951907+0000","last_peered":"2023-05-19T20:23:46.951907+0000","last_clean":"2023-05-19T20:23:46.951907+0000","last_became_active":"2023-05-19T20:23:46.951476+0000","last_became_peered":"2023-05-19T20:23:46.951476+0000","last_unstale":"2023-05-19T20:23:46.951907+0000","last_undegraded":"2023-05-19T20:23:46.951907+0000","last_fullsized":"2023-05-19T20:23:46.951907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T03:39:50.221953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.951508+0000","last_change":"2023-05-19T20:23:46.951508+0000","last_active":"2023-05-19T20:23:46.951508+0000","last_peered":"2023-05-19T20:23:46.951508+0000","last_clean":"2023-05-19T20:23:46.951508+0000","last_became_active":"2023-05-19T20:23:46.951144+0000","last_became_peered":"2023-05-19T20:23:46.951144+0000","last_unstale":"2023-05-19T20:23:46.951508+0000","last_undegraded":"2023-05-19T20:23:46.951508+0000","last_fullsized":"2023-05-19T20:23:46.951508+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-20T23:36:08.350622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.948263+0000","last_change":"2023-05-19T20:23:46.948263+0000","last_active":"2023-05-19T20:23:46.948263+0000","last_peered":"2023-05-19T20:23:46.948263+0000","last_clean":"2023-05-19T20:23:46.948263+0000","last_became_active":"2023-05-19T20:23:46.947653+0000","last_became_peered":"2023-05-19T20:23:46.947653+0000","last_unstale":"2023-05-19T20:23:46.948263+0000","last_undegraded":"2023-05-19T20:23:46.948263+0000","last_fullsized":"2023-05-19T20:23:46.948263+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-20T21:45:01.888408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.948894+0000","last_change":"2023-05-19T20:23:46.947170+0000","last_active":"2023-05-19T20:23:46.948894+0000","last_peered":"2023-05-19T20:23:46.948894+0000","last_clean":"2023-05-19T20:23:46.948894+0000","last_became_active":"2023-05-19T20:23:46.946646+0000","last_became_peered":"2023-05-19T20:23:46.946646+0000","last_unstale":"2023-05-19T20:23:46.948894+0000","last_undegraded":"2023-05-19T20:23:46.948894+0000","last_fullsized":"2023-05-19T20:23:46.948894+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T04:00:56.271695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.949848+0000","last_change":"2023-05-19T20:23:46.948235+0000","last_active":"2023-05-19T20:23:46.949848+0000","last_peered":"2023-05-19T20:23:46.949848+0000","last_clean":"2023-05-19T20:23:46.949848+0000","last_became_active":"2023-05-19T20:23:46.947668+0000","last_became_peered":"2023-05-19T20:23:46.947668+0000","last_unstale":"2023-05-19T20:23:46.949848+0000","last_undegraded":"2023-05-19T20:23:46.949848+0000","last_fullsized":"2023-05-19T20:23:46.949848+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T00:34:27.058141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-05-19T20:23:46.949490+0000","last_change":"2023-05-19T20:23:46.949490+0000","last_active":"2023-05-19T20:23:46.949490+0000","last_peered":"2023-05-19T20:23:46.949490+0000","last_clean":"2023-05-19T20:23:46.949490+0000","last_became_active":"2023-05-19T20:23:46.948602+0000","last_became_peered":"2023-05-19T20:23:46.948602+0000","last_unstale":"2023-05-19T20:23:46.949490+0000","last_undegraded":"2023-05-19T20:23:46.949490+0000","last_fullsized":"2023-05-19T20:23:46.949490+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:45.926803+0000","last_clean_scrub_stamp":"2023-05-19T20:23:45.926803+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T05:08:44.103002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":137,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-05-19T20:23:45.945322+0000","last_change":"2023-05-19T20:23:44.940319+0000","last_active":"2023-05-19T20:23:45.945322+0000","last_peered":"2023-05-19T20:23:45.945322+0000","last_clean":"2023-05-19T20:23:45.945322+0000","last_became_active":"2023-05-19T20:23:44.938128+0000","last_became_peered":"2023-05-19T20:23:44.938128+0000","last_unstale":"2023-05-19T20:23:45.945322+0000","last_undegraded":"2023-05-19T20:23:45.945322+0000","last_fullsized":"2023-05-19T20:23:45.945322+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-19T20:23:43.919549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-19T20:23:43.919549+0000","last_clean_scrub_stamp":"2023-05-19T20:23:43.919549+0000","objects_scrubbed":0,"log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-21T02:24:31.621412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":7208,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8120,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363720,"statfs":{"total":96636764160,"available":96628449280,"internally_reserved":0,"allocated":114688,"data_stored":30769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8620,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363220,"statfs":{"total":96636764160,"available":96627937280,"internally_reserved":0,"allocated":167936,"data_stored":620189,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8560,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363280,"statfs":{"total":96636764160,"available":96627998720,"internally_reserved":0,"allocated":172032,"data_stored":621137,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":3604,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-19T20:23:51.543 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-19T20:23:51.543 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-19T20:23:51.544 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-19T20:23:51.544 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-19T20:23:51.862 INFO:teuthology.orchestra.run.smithi163.stdout: 2023-05-19T20:23:51.862 INFO:teuthology.orchestra.run.smithi163.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-19T20:23:51.877 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-19T20:23:51.878 INFO:teuthology.run_tasks:Running task exec... 2023-05-19T20:23:51.892 INFO:teuthology.task.exec:Executing custom commands... 2023-05-19T20:23:51.892 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi163.front.sepia.ceph.com 2023-05-19T20:23:51.893 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-05-19T20:23:52.732 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cache' created 2023-05-19T20:23:52.745 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-05-19T20:23:53.743 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-05-19T20:23:53.756 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-05-19T20:23:54.748 INFO:teuthology.orchestra.run.smithi163.stderr:set cache-mode for pool 'cache' to writeback 2023-05-19T20:23:54.763 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-05-19T20:23:55.758 INFO:teuthology.orchestra.run.smithi163.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-05-19T20:23:55.774 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-05-19T20:23:56.761 INFO:teuthology.orchestra.run.smithi163.stderr:set pool 3 hit_set_type to bloom 2023-05-19T20:23:56.777 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-05-19T20:23:57.772 INFO:teuthology.orchestra.run.smithi163.stderr:set pool 3 hit_set_count to 8 2023-05-19T20:23:57.786 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-05-19T20:23:58.776 INFO:teuthology.orchestra.run.smithi163.stderr:set pool 3 hit_set_period to 60 2023-05-19T20:23:58.792 DEBUG:teuthology.orchestra.run.smithi163:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-05-19T20:23:59.782 INFO:teuthology.orchestra.run.smithi163.stderr:set pool 3 target_max_objects to 250 2023-05-19T20:23:59.798 INFO:teuthology.run_tasks:Running task workunit... 2023-05-19T20:23:59.825 INFO:tasks.workunit:Pulling workunits from ref 465d59c7325658c86eb5d8820da2d8fc49b7a1cd 2023-05-19T20:23:59.827 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-05-19T20:23:59.827 DEBUG:teuthology.orchestra.run.smithi163:> stat -- /home/ubuntu/cephtest/mnt.0 2023-05-19T20:23:59.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-19T20:23:59.835 INFO:teuthology.orchestra.run.smithi163.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-05-19T20:23:59.836 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-05-19T20:23:59.841 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-05-19T20:23:59.842 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-05-19T20:23:59.847 INFO:tasks.workunit:timeout=3h 2023-05-19T20:23:59.848 INFO:tasks.workunit:cleanup=True 2023-05-19T20:23:59.848 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 465d59c7325658c86eb5d8820da2d8fc49b7a1cd 2023-05-19T20:23:59.897 INFO:tasks.workunit.client.0.smithi163.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-05-19T20:24:43.213 INFO:tasks.workunit.client.0.smithi163.stderr:Note: switching to '465d59c7325658c86eb5d8820da2d8fc49b7a1cd'. 2023-05-19T20:24:43.213 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr:changes and commit them, and you can discard any commits you make in this 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr:state without impacting any branches by switching back to a branch. 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr:If you want to create a new branch to retain commits you create, you may 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr:do so (now or later) by using -c with the switch command. Example: 2023-05-19T20:24:43.214 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.215 INFO:tasks.workunit.client.0.smithi163.stderr: git switch -c 2023-05-19T20:24:43.215 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.215 INFO:tasks.workunit.client.0.smithi163.stderr:Or undo this operation with: 2023-05-19T20:24:43.215 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.216 INFO:tasks.workunit.client.0.smithi163.stderr: git switch - 2023-05-19T20:24:43.216 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.216 INFO:tasks.workunit.client.0.smithi163.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-05-19T20:24:43.216 INFO:tasks.workunit.client.0.smithi163.stderr: 2023-05-19T20:24:43.216 INFO:tasks.workunit.client.0.smithi163.stderr:HEAD is now at 465d59c7325 Merge branch 'wip-59711-quincy' of https://github.com/ajarr/ceph into wip-yuri4-testing-2023-05-18-0754-quincy 2023-05-19T20:24:43.219 DEBUG:teuthology.orchestra.run.smithi163:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-05-19T20:24:43.243 INFO:tasks.workunit.client.0.smithi163.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-05-19T20:24:43.247 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-05-19T20:24:43.247 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-05-19T20:24:44.104 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-05-19T20:24:44.210 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-05-19T20:24:44.267 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-05-19T20:24:44.268 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-05-19T20:24:44.268 INFO:tasks.workunit.client.0.smithi163.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-05-19T20:24:44.329 INFO:tasks.workunit.client.0.smithi163.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-05-19T20:24:44.332 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2023-05-19T20:24:44.332 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-05-19T20:24:44.339 INFO:tasks.workunit:Running workunits matching rbd/cli_migration.sh on client.0... 2023-05-19T20:24:44.340 INFO:tasks.workunit:Running workunit rbd/cli_migration.sh... 2023-05-19T20:24:44.340 DEBUG:teuthology.orchestra.run.smithi163:workunit test rbd/cli_migration.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=465d59c7325658c86eb5d8820da2d8fc49b7a1cd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh 2023-05-19T20:24:44.352 INFO:tasks.workunit.client.0.smithi163.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh 2023-05-19T20:24:44.353 INFO:tasks.workunit.client.0.smithi163.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-05-19T20:24:44.353 INFO:tasks.workunit.client.0.smithi163.stderr:++ TIMEOUT=300 2023-05-19T20:24:44.353 INFO:tasks.workunit.client.0.smithi163.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-05-19T20:24:44.353 INFO:tasks.workunit.client.0.smithi163.stderr:++ MAX_TIMEOUT=15 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ PG_NUM=4 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ TMPDIR=/tmp 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ type xmlstarlet 2023-05-19T20:24:44.354 INFO:tasks.workunit.client.0.smithi163.stderr:++ XMLSTARLET=xmlstarlet 2023-05-19T20:24:44.355 INFO:tasks.workunit.client.0.smithi163.stderr:+++ uname 2023-05-19T20:24:44.355 INFO:tasks.workunit.client.0.smithi163.stderr:++ '[' Linux = FreeBSD ']' 2023-05-19T20:24:44.355 INFO:tasks.workunit.client.0.smithi163.stderr:++ SED=sed 2023-05-19T20:24:44.355 INFO:tasks.workunit.client.0.smithi163.stderr:++ AWK=awk 2023-05-19T20:24:44.356 INFO:tasks.workunit.client.0.smithi163.stderr:+++ stty -a 2023-05-19T20:24:44.356 INFO:tasks.workunit.client.0.smithi163.stderr:+++ head -1 2023-05-19T20:24:44.356 INFO:tasks.workunit.client.0.smithi163.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-05-19T20:24:44.362 INFO:tasks.workunit.client.0.smithi163.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-05-19T20:24:44.363 INFO:tasks.workunit.client.0.smithi163.stderr:++ termwidth= 2023-05-19T20:24:44.363 INFO:tasks.workunit.client.0.smithi163.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-05-19T20:24:44.363 INFO:tasks.workunit.client.0.smithi163.stderr:++ DIFFCOLOPTS='-y ' 2023-05-19T20:24:44.363 INFO:tasks.workunit.client.0.smithi163.stderr:++ KERNCORE=kernel.core_pattern 2023-05-19T20:24:44.363 INFO:tasks.workunit.client.0.smithi163.stderr:++ EXTRA_OPTS= 2023-05-19T20:24:44.372 INFO:tasks.workunit.client.0.smithi163.stderr:++ test '' = TESTS 2023-05-19T20:24:44.373 INFO:tasks.workunit.client.0.smithi163.stderr:+ TEMPDIR= 2023-05-19T20:24:44.373 INFO:tasks.workunit.client.0.smithi163.stderr:+ IMAGE1=image1 2023-05-19T20:24:44.373 INFO:tasks.workunit.client.0.smithi163.stderr:+ IMAGE2=image2 2023-05-19T20:24:44.373 INFO:tasks.workunit.client.0.smithi163.stderr:+ IMAGE3=image3 2023-05-19T20:24:44.373 INFO:tasks.workunit.client.0.smithi163.stderr:+ IMAGES='image1 image2 image3' 2023-05-19T20:24:44.374 INFO:tasks.workunit.client.0.smithi163.stderr:+ rbd ls 2023-05-19T20:24:44.375 INFO:tasks.workunit.client.0.smithi163.stderr:+ wc -l 2023-05-19T20:24:44.375 INFO:tasks.workunit.client.0.smithi163.stderr:+ grep -v '^0$' 2023-05-19T20:24:44.422 INFO:tasks.workunit.client.0.smithi163.stderr:+ setup_tempdir 2023-05-19T20:24:44.423 INFO:tasks.workunit.client.0.smithi163.stderr:++ mktemp -d 2023-05-19T20:24:44.423 INFO:tasks.workunit.client.0.smithi163.stderr:+ TEMPDIR=/tmp/tmp.43hiY89YHo 2023-05-19T20:24:44.424 INFO:tasks.workunit.client.0.smithi163.stderr:+ trap 'cleanup $?' INT TERM EXIT 2023-05-19T20:24:44.424 INFO:tasks.workunit.client.0.smithi163.stderr:+ create_base_image image1 2023-05-19T20:24:44.424 INFO:tasks.workunit.client.0.smithi163.stderr:+ local image=image1 2023-05-19T20:24:44.424 INFO:tasks.workunit.client.0.smithi163.stderr:+ rbd create --size 1G image1 2023-05-19T20:24:45.800 INFO:tasks.workunit.client.0.smithi163.stderr:+ rbd bench --io-type write --io-pattern rand --io-size=4K --io-total 256M image1 2023-05-19T20:24:45.864 INFO:tasks.workunit.client.0.smithi163.stdout:bench type write io_size 4096 io_threads 16 bytes 268435456 pattern random 2023-05-19T20:24:47.520 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:47.510+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa8008740 msgr2=0x7f5fa800abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:47.829 INFO:tasks.workunit.client.0.smithi163.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-05-19T20:24:47.830 INFO:tasks.workunit.client.0.smithi163.stdout: 1 2816 1441.99 5.6 MiB/s 2023-05-19T20:24:47.924 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:47.914+0000 7f5fc4669700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6808/29215,v1:172.21.15.163:6809/29215] conn(0x7f5fa8008740 msgr2=0x7f5fa40e6f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:47.928 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:47.918+0000 7f5fc4669700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6808/29215,v1:172.21.15.163:6809/29215] conn(0x5561d64d88e0 msgr2=0x7f5fa4135c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T20:24:48.750 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:48.742+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa40368d0 msgr2=0x7f5fa40ced90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:48.754 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:48.746+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d64d88e0 msgr2=0x7f5fa4043b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T20:24:48.758 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:48.750+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa40368d0 msgr2=0x7f5fa40b8a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T20:24:48.768 INFO:tasks.workunit.client.0.smithi163.stdout: 2 2832 982.092 3.8 MiB/s 2023-05-19T20:24:48.919 INFO:tasks.workunit.client.0.smithi163.stdout: 3 2848 938.423 3.7 MiB/s 2023-05-19T20:24:49.024 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:49.014+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d64d88e0 msgr2=0x7f5fa40b94a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T20:24:49.715 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:49.706+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa40368d0 msgr2=0x7f5fa40bb480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:49.973 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:49.966+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa8008740 msgr2=0x7f5fa4038cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:50.081 INFO:tasks.workunit.client.0.smithi163.stdout: 4 5264 1253.59 4.9 MiB/s 2023-05-19T20:24:50.580 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:50.570+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa40368d0 msgr2=0x7f5fa407aaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:50.768 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:50.758+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa8008740 msgr2=0x7f5fa4038cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:24:50.874 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T20:24:50.866+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa40368d0 msgr2=0x7f5fa40baac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T20:25:21.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:21.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:21.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:21.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:22.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:22.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:22.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:22.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:23.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:23.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:23.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:23.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:24.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:24.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:24.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:24.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:25.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:25.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:25.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:25.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:26.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:26.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:26.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:26.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:27.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:27.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:27.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:27.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:28.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:28.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:28.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:28.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:29.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:29.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:29.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:29.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:30.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:30.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:30.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:30.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:31.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:31.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:31.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:31.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:32.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:32.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:32.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:32.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:33.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:33.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:33.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:33.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:34.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:34.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:34.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:34.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:35.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:35.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:35.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:35.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:36.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:36.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:36.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:36.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:37.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:37.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:37.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:37.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:38.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:38.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:38.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:38.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:39.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:39.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:39.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:39.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:40.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:40.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:40.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:40.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:41.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:41.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:41.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:41.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:42.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:42.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:42.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:42.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:43.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:43.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:43.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:43.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:44.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:44.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:44.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:44.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:45.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:45.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:45.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:45.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:46.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:46.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:46.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:46.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:47.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:47.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:47.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:47.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:48.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:48.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:48.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:48.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:49.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:49.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:49.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:49.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:50.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:50.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:50.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:50.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:51.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:51.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:51.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:51.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:52.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:52.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:52.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:52.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:53.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:53.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:53.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:53.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:54.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:54.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:54.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:54.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:55.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:55.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:55.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:55.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:56.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:56.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:56.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:56.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:57.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:57.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:57.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:57.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:58.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:58.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:58.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:58.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:59.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:25:59.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:25:59.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:25:59.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:00.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:00.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:00.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:00.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:01.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:01.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:01.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:01.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:02.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:02.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:02.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:02.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:03.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:03.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:03.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:03.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:04.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:04.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:04.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:04.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:05.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:05.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:05.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:05.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:06.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:06.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:06.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:06.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:07.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:07.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:07.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:07.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:08.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:08.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:08.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:08.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:09.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:09.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:09.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:09.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:10.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:10.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:10.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:10.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:11.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:11.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:11.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:11.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:12.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:12.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:12.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:12.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:13.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:13.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:13.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:13.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:14.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:14.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:14.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:14.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:15.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:15.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:15.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:15.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:16.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:16.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:16.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:16.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:17.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:17.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:17.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:17.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:18.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:18.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:18.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:18.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:19.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:19.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:19.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:19.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:20.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:20.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:20.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:20.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:21.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:21.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:21.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:21.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:22.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:22.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:22.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:22.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:23.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:23.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:23.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:23.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:24.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:24.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:24.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:24.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:25.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:25.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:25.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:25.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:26.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:26.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:26.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:26.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:27.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:27.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:27.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:27.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:28.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:28.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:28.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:28.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:29.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:29.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:29.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:29.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:30.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:30.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:30.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:30.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:31.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:31.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:31.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:31.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:32.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:32.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:32.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:32.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:33.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:33.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:33.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:33.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:34.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:34.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:34.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:34.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:35.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:35.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:35.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:35.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:36.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:36.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:36.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:36.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:37.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:37.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:37.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:37.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:38.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:38.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:38.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:38.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:39.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:39.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:39.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:39.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:40.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:40.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:40.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:40.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:41.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:41.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:41.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:41.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:42.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:42.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:42.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:42.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:43.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:43.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:43.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:43.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:44.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:44.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:44.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:44.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:45.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:45.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:45.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:45.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:46.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:46.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:46.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:46.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:47.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:47.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:47.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:47.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:48.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:48.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:48.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:48.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:49.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:49.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:49.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:49.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:50.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:50.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:50.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:50.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:51.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:51.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:51.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:51.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:52.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:52.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:52.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:52.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:53.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:53.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:53.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:53.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:54.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:54.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:54.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:54.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:55.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:55.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:55.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:55.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:56.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:56.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:56.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:56.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:57.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:57.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:57.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:57.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:58.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:58.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:58.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:58.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:59.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:26:59.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:26:59.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:26:59.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:00.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:00.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:00.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:00.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:01.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:01.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:01.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:01.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:02.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:02.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:02.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:02.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:03.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:03.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:03.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:03.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:04.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:04.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:04.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:04.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:05.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:05.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:05.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:05.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:06.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:06.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:06.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:06.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:07.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:07.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:07.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:07.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:08.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:08.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:08.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:08.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:09.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:09.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:09.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:09.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:10.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:10.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:10.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:10.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:11.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:11.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:11.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:11.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:12.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:12.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:12.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:12.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:13.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:13.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:13.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:13.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:14.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:14.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:14.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:14.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:15.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:15.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:15.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:15.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:16.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:16.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:16.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:16.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:17.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:17.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:17.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:17.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:18.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:18.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:18.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:18.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:19.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:19.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:19.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:19.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:20.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:20.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:20.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:20.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:21.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:21.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:21.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:21.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:22.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:22.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:23.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:23.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:23.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:23.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:24.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:24.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:24.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:24.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:25.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:25.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:25.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:25.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:25.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:25.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:26.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:26.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:27.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:26.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:27.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:27.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:28.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:28.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:28.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:28.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:29.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:28.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:29.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:29.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:30.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:29.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:30.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:30.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:30.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:30.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:31.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:31.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:31.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:31.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:32.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:32.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:33.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:32.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:33.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:33.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:33.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:33.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:34.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:34.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:34.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:34.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:35.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:35.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:35.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:35.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:36.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:36.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:36.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:36.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:37.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:37.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:37.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:37.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:38.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:38.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:38.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:38.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:39.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:39.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:39.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:39.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:40.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:40.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:40.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:40.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:41.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:41.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:41.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:41.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:42.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:42.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:42.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:42.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:43.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:43.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:43.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:43.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:44.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:44.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:44.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:44.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:45.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:45.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:45.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:45.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:46.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:46.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:46.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:46.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:47.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:47.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:47.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:47.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:48.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:48.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:48.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:48.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:49.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:49.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:49.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:49.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:50.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:50.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:50.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:50.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:51.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:51.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:51.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:51.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:52.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:52.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:52.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:52.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:53.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:53.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:53.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:53.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:54.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:54.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:54.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:54.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:55.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:55.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:55.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:55.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:56.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:56.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:56.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:56.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:57.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:57.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:57.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:57.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:58.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:58.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:58.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:58.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:59.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:27:59.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:27:59.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:27:59.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:00.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:00.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:00.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:00.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:01.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:01.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:01.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:01.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:02.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:02.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:02.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:02.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:03.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:03.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:03.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:03.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:04.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:04.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:04.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:04.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:05.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:05.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:05.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:05.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:06.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:06.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:06.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:06.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:07.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:07.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:07.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:07.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:08.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:08.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:08.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:08.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:09.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:09.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:09.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:09.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:10.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:10.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:10.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:10.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:11.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:11.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:11.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:11.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:12.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:12.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:12.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:12.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:13.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:13.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:13.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:13.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:14.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:14.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:14.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:14.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:15.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:15.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:15.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:15.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:16.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:16.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:16.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:16.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:17.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:17.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:17.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:17.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:18.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:18.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:18.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:18.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:19.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:19.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:19.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:19.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:20.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:20.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:20.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:20.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:21.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:21.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:21.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:21.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:22.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:22.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:22.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:22.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:23.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:23.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:23.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:23.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:24.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:24.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:24.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:24.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:25.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:25.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:25.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:25.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:26.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:26.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:26.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:26.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:27.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:27.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:27.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:27.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:28.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:28.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:28.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:28.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:29.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:29.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:29.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:29.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:30.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:30.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:30.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:30.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:31.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:31.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:31.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:31.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:32.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:32.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:32.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:32.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:33.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:33.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:33.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:33.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:34.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:34.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:34.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:34.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:35.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:35.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:35.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:35.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:36.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:36.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:36.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:36.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:37.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:37.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:37.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:37.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:38.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:38.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:38.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:38.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:39.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:39.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:39.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:39.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:40.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:40.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:40.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:40.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:41.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:41.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:41.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:41.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:42.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:42.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:42.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:42.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:43.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:43.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:43.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:43.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:44.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:44.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:44.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:44.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:45.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:45.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:45.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:45.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:46.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:46.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:46.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:46.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:47.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:47.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:47.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:47.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:48.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:48.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:48.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:48.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:49.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:49.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:49.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:49.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:50.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:50.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:50.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:50.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:51.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:51.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:51.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:51.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:52.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:52.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:52.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:52.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:53.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:53.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:53.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:53.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:54.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:54.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:54.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:54.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:55.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:55.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:55.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:55.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:56.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:56.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:56.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:56.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:57.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:57.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:57.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:57.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:58.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:58.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:58.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:58.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:59.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:28:59.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:28:59.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:28:59.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:00.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:00.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:00.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:00.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:01.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:01.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:01.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:01.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:02.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:02.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:02.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:02.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:03.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:03.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:03.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:03.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:04.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:04.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:04.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:04.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:05.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:05.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:05.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:05.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:06.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:06.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:06.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:06.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:07.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:07.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:07.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:07.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:08.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:08.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:08.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:08.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:09.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:09.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:09.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:09.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:10.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:10.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:10.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:10.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:11.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:11.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:11.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:11.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:12.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:12.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:12.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:12.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:13.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:13.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:13.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:13.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:14.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:14.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:14.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:14.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:15.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:15.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:15.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:15.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:16.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:16.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:16.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:16.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:17.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:17.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:17.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:18.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:18.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:18.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:18.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:19.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:19.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:19.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:19.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:20.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:20.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:20.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:20.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:21.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:21.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:21.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:21.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:22.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:22.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:22.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:22.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:23.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:23.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:24.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:24.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:24.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:24.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:25.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:25.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:25.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:25.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:26.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:26.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:26.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:26.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:27.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:27.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:27.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:27.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:28.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:28.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:28.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:28.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:28.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:28.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:29.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:29.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:29.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:29.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:30.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:30.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:30.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:30.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:31.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:31.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:32.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:32.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:32.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:32.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:33.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:33.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:33.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:33.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:34.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:34.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:34.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:34.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:35.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:35.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:35.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:35.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:36.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:36.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:36.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:36.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:37.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:37.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:37.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:37.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:38.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:38.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:38.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:38.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:39.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:39.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:39.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:39.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:40.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:40.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:40.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:40.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:41.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:41.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:41.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:41.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:42.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:42.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:42.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:42.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:43.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:43.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:43.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:43.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:44.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:44.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:44.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:44.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:44.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:44.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:45.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:45.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:45.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:45.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:46.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:46.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:46.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:46.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:47.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:47.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:47.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:47.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:48.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:48.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:48.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:48.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:49.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:49.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:49.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:49.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:50.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:50.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:50.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:50.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:51.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:51.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:51.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:51.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:52.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:52.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:52.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:52.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:53.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:53.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:53.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:53.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:54.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:54.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:54.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:54.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:55.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:55.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:55.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:55.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:56.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:56.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:56.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:56.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:57.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:57.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:57.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:57.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:58.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:58.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:58.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:58.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:59.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:29:59.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:29:59.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:29:59.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:00.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:00.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:00.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:00.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:01.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:01.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:01.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:01.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:02.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:02.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:02.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:02.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:03.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:03.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:03.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:03.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:04.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:04.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:04.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:04.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:05.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:05.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:05.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:05.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:06.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:06.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:06.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:06.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:07.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:07.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:07.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:07.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:08.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:08.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:08.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:08.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:09.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:09.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:09.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:09.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:10.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:10.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:10.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:10.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:11.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:11.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:11.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:11.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:12.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:12.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:12.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:12.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:13.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:13.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:13.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:13.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:14.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:14.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:14.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:14.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:15.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:15.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:15.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:15.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:16.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:16.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:16.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:16.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:17.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:17.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:17.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:17.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:18.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:18.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:18.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:18.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:19.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:19.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:19.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:19.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:20.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:20.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:20.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:20.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:21.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:21.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:21.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:21.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:22.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:22.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:22.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:22.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:23.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:23.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:23.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:23.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:24.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:24.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:24.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:24.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:25.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:25.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:25.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:25.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:26.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:26.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:26.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:26.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:27.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:27.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:27.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:27.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:28.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:28.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:28.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:28.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:29.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:29.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:29.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:29.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:30.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:30.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:30.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:30.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:31.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:31.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:31.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:31.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:32.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:32.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:32.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:32.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:33.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:33.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:33.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:33.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:34.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:34.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:34.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:34.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:35.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:35.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:35.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:35.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:36.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:36.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:36.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:36.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:37.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:37.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:37.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:37.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:38.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:38.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:38.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:38.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:39.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:39.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:39.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:39.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:40.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:40.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:40.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:40.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:41.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:41.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:41.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:41.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:42.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:42.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:42.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:42.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:43.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:43.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:43.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:43.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:44.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:44.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:44.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:44.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:45.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:45.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:45.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:45.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:46.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:46.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:46.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:46.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:47.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:47.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:47.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:47.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:48.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:48.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:48.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:48.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:49.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:49.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:49.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:49.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:50.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:50.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:50.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:50.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:51.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:51.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:51.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:51.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:52.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:52.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:52.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:52.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:53.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:53.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:53.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:53.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:54.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:54.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:54.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:54.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:55.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:55.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:55.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:55.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:56.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:56.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:56.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:56.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:57.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:57.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:57.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:57.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:58.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:58.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:58.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:58.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:59.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:30:59.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:30:59.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:30:59.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:00.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:00.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:00.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:00.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:01.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:01.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:01.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:01.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:02.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:02.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:02.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:02.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:03.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:03.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:03.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:03.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:04.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:04.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:04.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:04.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:05.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:05.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:05.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:05.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:06.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:06.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:06.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:06.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:07.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:07.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:07.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:07.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:08.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:08.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:08.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:08.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:09.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:09.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:09.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:09.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:10.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:10.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:10.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:10.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:11.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:11.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:12.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:12.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:12.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:12.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:13.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:13.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:13.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:13.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:14.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:14.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:14.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:14.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:15.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:15.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:15.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:15.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:16.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:16.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:16.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:16.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:17.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:17.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:17.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:17.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:18.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:18.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:18.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:18.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:19.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:19.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:19.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:19.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:20.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:20.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:20.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:20.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:21.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:21.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:21.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:21.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:22.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:21.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:22.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:22.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:23.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:23.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:23.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:23.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:24.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:24.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:24.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:24.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:25.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:25.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:25.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:25.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:26.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:26.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:26.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:26.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:27.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:27.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:27.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:27.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:28.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:28.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:28.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:28.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:29.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:29.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:29.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:29.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:30.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:30.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:30.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:30.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:31.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:31.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:31.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:31.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:32.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:32.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:32.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:32.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:33.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:33.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:33.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:33.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:34.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:34.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:34.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:34.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:35.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:35.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:35.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:35.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:36.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:36.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:36.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:36.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:37.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:37.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:37.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:37.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:38.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:38.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:38.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:38.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:39.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:39.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:39.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:39.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:40.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:40.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:40.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:40.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:41.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:41.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:41.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:41.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:42.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:42.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:42.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:42.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:43.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:43.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:43.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:43.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:44.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:44.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:44.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:44.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:45.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:45.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:45.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:45.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:46.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:46.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:46.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:46.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:47.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:47.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:47.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:47.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:48.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:48.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:48.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:48.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:49.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:49.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:49.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:49.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:50.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:50.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:50.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:50.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:51.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:51.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:51.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:51.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:52.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:52.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:52.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:52.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:53.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:53.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:53.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:53.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:54.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:54.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:54.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:54.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:55.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:55.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:55.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:55.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:56.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:56.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:56.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:56.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:57.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:57.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:57.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:57.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:58.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:58.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:58.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:58.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:59.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:31:59.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:31:59.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:31:59.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:00.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:00.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:00.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:00.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:01.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:01.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:01.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:01.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:02.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:02.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:02.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:02.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:03.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:03.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:03.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:03.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:04.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:04.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:04.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:04.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:05.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:05.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:05.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:05.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:06.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:06.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:06.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:06.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:07.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:07.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:07.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:07.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:08.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:08.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:08.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:08.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:09.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:09.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:09.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:09.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:10.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:10.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:10.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:10.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:11.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:11.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:11.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:11.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:12.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:12.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:12.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:12.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:13.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:13.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:13.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:13.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:14.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:14.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:14.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:14.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:15.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:15.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:15.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:15.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:16.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:16.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:16.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:16.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:17.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:17.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:17.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:17.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:18.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:18.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:18.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:18.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:19.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:19.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:19.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:19.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:20.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:20.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:20.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:20.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:21.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:21.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:21.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:21.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:22.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:22.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:22.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:22.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:23.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:23.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:23.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:23.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:24.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:24.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:24.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:24.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:25.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:25.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:25.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:25.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:26.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:26.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:26.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:26.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:27.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:27.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:27.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:27.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:28.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:28.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:28.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:28.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:29.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:29.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:29.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:29.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:30.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:30.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:30.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:30.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:31.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:31.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:31.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:31.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:32.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:32.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:32.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:32.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:33.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:33.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:33.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:33.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:34.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:34.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:34.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:34.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:35.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:35.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:35.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:35.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:36.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:36.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:36.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:36.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:37.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:37.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:37.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:37.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:38.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:38.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:38.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:38.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:39.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:39.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:39.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:39.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:40.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:40.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:40.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:40.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:41.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:41.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:41.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:41.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:42.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:42.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:42.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:42.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:43.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:43.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:43.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:43.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:44.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:44.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:44.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:44.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:45.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:45.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:45.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:45.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:46.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:46.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:46.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:46.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:47.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:47.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:47.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:47.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:48.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:48.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:48.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:48.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:49.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:49.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:49.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:49.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:50.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:50.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:50.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:50.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:51.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:51.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:51.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:51.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:52.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:52.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:52.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:52.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:53.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:53.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:53.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:53.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:54.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:54.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:54.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:54.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:55.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:55.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:55.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:55.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:56.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:56.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:56.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:56.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:57.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:57.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:57.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:57.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:58.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:58.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:58.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:58.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:59.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:32:59.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:32:59.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:32:59.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:00.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:00.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:00.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:00.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:01.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:01.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:01.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:01.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:02.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:02.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:02.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:02.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:03.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:03.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:03.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:03.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:04.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:04.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:04.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:04.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:05.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:05.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:05.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:05.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:06.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:06.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:06.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:06.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:07.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:07.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:07.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:07.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:08.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:08.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:08.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:08.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:09.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:09.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:09.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:09.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:10.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:10.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:10.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:10.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:11.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:11.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:11.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:11.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:12.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:12.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:12.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:12.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:13.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:13.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:13.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:13.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:14.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:14.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:14.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:14.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:15.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:15.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:15.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:15.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:16.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:16.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:16.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:16.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:17.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:17.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:17.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:17.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:18.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:18.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:18.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:18.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:19.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:19.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:19.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:19.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:20.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:20.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:20.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:20.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:21.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:21.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:21.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:21.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:22.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:22.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:22.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:22.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:23.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:23.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:23.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:23.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:24.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:24.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:24.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:24.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:25.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:25.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:25.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:25.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:26.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:26.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:26.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:26.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:27.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:27.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:27.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:27.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:28.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:28.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:28.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:28.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:29.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:29.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:29.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:29.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:30.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:30.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:30.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:30.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:31.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:31.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:31.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:31.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:32.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:32.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:32.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:32.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:33.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:33.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:33.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:33.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:34.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:34.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:34.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:34.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:35.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:35.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:35.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:35.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:36.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:36.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:36.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:36.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:37.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:37.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:37.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:37.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:38.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:38.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:38.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:38.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:39.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:39.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:39.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:39.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:40.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:40.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:40.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:40.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:41.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:41.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:41.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:41.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:42.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:42.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:42.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:42.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:43.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:43.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:43.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:43.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:44.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:44.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:44.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:44.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:45.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:45.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:45.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:45.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:46.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:46.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:46.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:46.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:47.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:47.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:47.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:47.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:48.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:48.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:48.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:48.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:49.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:49.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:49.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:49.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:50.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:50.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:50.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:50.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:51.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:51.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:51.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:51.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:52.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:52.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:52.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:52.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:53.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:53.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:54.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:54.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:54.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:54.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:55.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:55.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:55.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:55.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:56.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:56.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:56.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:56.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:57.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:57.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:57.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:57.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:58.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:58.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:58.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:58.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:58.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:58.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:59.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:33:59.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:33:59.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:33:59.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:00.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:00.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:00.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:00.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:01.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:01.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:01.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:01.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:02.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:02.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:02.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:02.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:03.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:03.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:03.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:03.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:04.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:04.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:04.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:04.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:05.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:05.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:05.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:05.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:06.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:06.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:06.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:06.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:07.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:07.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:07.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:07.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:08.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:08.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:08.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:08.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:09.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:09.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:09.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:09.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:10.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:10.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:10.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:10.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:11.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:11.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:12.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:11.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:12.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:12.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:13.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:13.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:13.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:13.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:13.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:13.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:14.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:14.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:14.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:14.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:15.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:15.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:15.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:15.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:16.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:16.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:16.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:16.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:17.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:17.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:17.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:17.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:18.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:18.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:18.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:18.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:19.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:19.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:20.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:19.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:20.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:20.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:21.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:21.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:21.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:21.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:22.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:22.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:22.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:22.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:23.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:23.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:23.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:23.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:24.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:24.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:24.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:24.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:25.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:25.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:25.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:25.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:26.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:26.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:26.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:26.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:27.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:27.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:27.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:27.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:28.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:28.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:28.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:28.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:29.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:29.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:29.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:29.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:30.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:30.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:30.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:30.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:31.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:31.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:31.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:31.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:31.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:31.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:32.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:32.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:32.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:32.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:33.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:33.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:33.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:33.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:34.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:34.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:34.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:34.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:35.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:35.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:35.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:35.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:36.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:36.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:36.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:36.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:37.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:37.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:37.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:37.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:38.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:38.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:38.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:39.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:39.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:39.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:39.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:40.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:40.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:40.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:40.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:41.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:41.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:41.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:41.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:42.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:42.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:42.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:42.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:43.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:43.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:43.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:43.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:44.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:44.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:44.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:44.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:45.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:45.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:45.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:45.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:46.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:46.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:46.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:46.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:47.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:47.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:47.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:47.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:48.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:48.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:48.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:48.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:49.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:49.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:49.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:49.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:50.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:50.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:50.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:50.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:51.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:51.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:51.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:51.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:52.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:52.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:53.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:53.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:53.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:53.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:54.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:54.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:54.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:54.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:55.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:55.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:55.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:55.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:55.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:55.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:56.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:56.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:57.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:57.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:57.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:57.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:58.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:58.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:58.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:58.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:59.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:34:58.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:34:59.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:34:59.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:00.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:00.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:00.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:00.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:01.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:01.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:01.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:01.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:02.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:02.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:02.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:02.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:03.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:03.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:03.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:03.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:04.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:04.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:04.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:04.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:05.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:05.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:05.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:05.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:06.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:06.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:06.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:06.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:07.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:07.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:07.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:07.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:08.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:08.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:09.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:09.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:09.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:09.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:10.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:10.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:10.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:10.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:11.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:11.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:11.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:11.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:12.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:12.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:12.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:12.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:13.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:13.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:13.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:13.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:14.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:14.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:14.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:14.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:15.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:15.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:15.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:15.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:16.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:16.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:16.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:16.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:17.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:17.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:17.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:17.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:18.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:18.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:18.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:18.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:19.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:19.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:19.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:19.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:20.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:20.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:20.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:20.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:21.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:21.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:21.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:21.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:22.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:22.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:22.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:22.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:22.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:22.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:23.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:23.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:24.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:24.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:24.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:24.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:25.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:25.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:25.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:25.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:26.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:26.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:26.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:26.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:27.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:27.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:27.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:27.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:28.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:28.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:28.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:28.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:29.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:29.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:29.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:29.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:30.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:30.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:30.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:30.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:31.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:31.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:31.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:31.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:32.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:32.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:32.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:32.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:33.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:33.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:33.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:33.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:34.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:34.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:34.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:34.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:35.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:35.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:35.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:35.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:36.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:36.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:36.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:36.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:37.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:37.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:37.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:37.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:38.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:38.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:38.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:38.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:39.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:39.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:39.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:39.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:40.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:40.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:40.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:40.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:41.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:41.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:41.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:41.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:42.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:42.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:42.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:42.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:43.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:43.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:43.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:43.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:44.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:44.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:44.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:44.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:45.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:45.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:45.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:45.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:46.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:46.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:46.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:46.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:47.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:47.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:47.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:47.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:48.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:48.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:48.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:48.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:49.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:49.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:49.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:49.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:50.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:50.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:50.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:50.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:51.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:51.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:51.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:51.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:52.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:52.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:52.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:52.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:53.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:53.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:53.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:53.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:54.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:54.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:54.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:54.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:55.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:55.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:55.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:55.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:56.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:56.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:56.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:56.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:57.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:57.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:57.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:57.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:58.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:58.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:58.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:58.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:59.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:35:59.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:35:59.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:35:59.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:00.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:00.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:00.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:00.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:01.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:01.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:01.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:01.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:02.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:02.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:02.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:02.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:03.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:03.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:03.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:03.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:04.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:04.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:04.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:04.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:05.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:05.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:05.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:05.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:06.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:06.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:06.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:06.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:07.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:07.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:07.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:07.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:08.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:08.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:08.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:08.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:09.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:09.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:09.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:09.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:10.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:10.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:10.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:10.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:11.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:11.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:11.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:11.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:12.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:12.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:12.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:12.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:13.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:13.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:13.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:14.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:14.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:14.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:14.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:15.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:15.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:15.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:15.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:16.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:16.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:16.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:16.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:17.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:17.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:17.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:17.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:18.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:18.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:18.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:18.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:19.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:19.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:19.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:19.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:20.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:20.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:20.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:20.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:21.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:21.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:21.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:21.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:22.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:22.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:22.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:22.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:23.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:23.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:23.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:23.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:24.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:24.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:24.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:24.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:25.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:25.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:25.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:25.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:26.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:26.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:26.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:26.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:26.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:26.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:27.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:27.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:27.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:27.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:28.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:28.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:28.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:28.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:29.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:29.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:29.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:29.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:30.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:30.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:30.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:30.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:31.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:31.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:32.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:32.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:32.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:32.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:33.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:33.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:33.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:33.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:34.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:34.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:34.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:34.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:35.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:35.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:35.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:35.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:35.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:35.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:36.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:36.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:37.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:37.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:37.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:37.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:38.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:38.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:38.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:38.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:39.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:39.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:39.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:39.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:40.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:40.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:40.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:40.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:41.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:41.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:41.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:41.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:42.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:42.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:42.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:42.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:43.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:43.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:43.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:43.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:44.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:44.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:44.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:44.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:45.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:45.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:45.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:45.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:46.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:46.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:46.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:46.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:47.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:47.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:47.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:47.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:48.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:48.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:48.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:48.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:49.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:49.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:49.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:49.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:50.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:50.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:50.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:50.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:51.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:51.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:51.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:51.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:52.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:52.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:52.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:52.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:53.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:53.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:53.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:53.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:54.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:54.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:54.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:54.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:55.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:55.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:55.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:55.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:56.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:56.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:56.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:56.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:57.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:57.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:57.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:57.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:58.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:58.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:58.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:58.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:59.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:36:59.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:36:59.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:36:59.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:00.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:00.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:00.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:00.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:01.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:01.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:01.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:01.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:02.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:02.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:02.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:02.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:03.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:03.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:03.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:03.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:04.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:04.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:04.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:04.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:05.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:05.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:05.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:05.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:06.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:06.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:06.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:06.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:06.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:06.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:07.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:07.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:07.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:07.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:08.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:08.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:08.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:08.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:09.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:09.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:09.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:09.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:10.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:10.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:10.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:10.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:11.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:11.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:11.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:11.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:12.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:12.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:12.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:12.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:13.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:13.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:13.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:13.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:14.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:14.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:14.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:14.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:15.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:15.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:15.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:15.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:16.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:16.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:16.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:16.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:17.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:17.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:17.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:17.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:18.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:18.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:18.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:18.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:19.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:19.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:19.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:19.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:20.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:20.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:20.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:20.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:21.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:21.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:21.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:21.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:22.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:22.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:22.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:22.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:23.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:23.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:23.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:23.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:24.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:24.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:24.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:25.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:25.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:25.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:25.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:26.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:26.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:26.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:26.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:27.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:27.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:27.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:27.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:28.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:28.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:28.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:28.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:29.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:29.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:29.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:29.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:30.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:30.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:30.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:30.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:31.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:31.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:31.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:31.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:32.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:32.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:32.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:32.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:33.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:33.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:33.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:33.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:34.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:34.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:34.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:34.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:34.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:34.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:35.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:35.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:36.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:36.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:36.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:36.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:36.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:36.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:37.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:37.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:37.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:37.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:38.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:38.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:38.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:38.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:39.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:39.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:40.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:40.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:40.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:40.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:40.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:40.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:42.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:42.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:42.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:42.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:43.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:43.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:43.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:43.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:44.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:44.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:44.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:44.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:45.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:45.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:45.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:45.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:46.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:46.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:46.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:46.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:47.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:47.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:47.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:47.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:48.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:48.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:48.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:48.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:49.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:49.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:49.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:49.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:50.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:50.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:50.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:50.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:51.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:51.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:51.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:51.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:52.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:52.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:52.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:52.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:53.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:53.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:53.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:53.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:54.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:54.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:54.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:54.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:55.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:55.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:55.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:55.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:55.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:55.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:56.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:56.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:57.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:57.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:57.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:57.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:58.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:58.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:58.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:58.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:59.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:37:59.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:37:59.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:37:59.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:00.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:00.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:00.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:00.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:01.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:01.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:01.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:01.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:02.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:02.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:02.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:02.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:03.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:03.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:03.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:03.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:04.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:04.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:04.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:04.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:05.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:05.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:05.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:05.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:06.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:06.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:06.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:06.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:07.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:07.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:07.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:07.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:08.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:08.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:08.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:08.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:09.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:09.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:09.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:09.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:10.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:10.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:10.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:10.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:11.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:11.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:11.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:11.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:12.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:12.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:12.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:12.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:13.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:13.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:13.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:13.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:14.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:14.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:14.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:14.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:15.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:15.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:15.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:15.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:16.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:16.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:16.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:16.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:17.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:17.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:17.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:17.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:18.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:18.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:18.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:18.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:19.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:19.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:19.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:19.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:20.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:20.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:20.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:20.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:21.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:21.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:21.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:21.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:22.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:22.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:22.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:22.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:23.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:23.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:23.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:23.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:24.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:24.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:24.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:24.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:25.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:25.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:25.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:25.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:26.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:26.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:26.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:26.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:27.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:27.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:27.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:27.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:28.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:28.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:28.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:28.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:29.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:29.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:29.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:29.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:30.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:30.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:30.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:30.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:31.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:31.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:31.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:31.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:32.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:32.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:32.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:32.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:33.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:33.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:33.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:33.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:34.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:34.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:34.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:34.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:35.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:35.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:35.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:35.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:36.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:36.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:36.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:36.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:37.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:37.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:37.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:37.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:38.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:38.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:38.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:38.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:39.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:39.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:39.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:39.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:40.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:40.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:40.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:40.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:41.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:41.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:41.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:41.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:42.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:42.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:42.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:42.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:43.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:43.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:43.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:43.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:44.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:44.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:44.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:44.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:45.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:45.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:45.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:45.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:46.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:46.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:46.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:46.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:47.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:47.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:47.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:47.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:48.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:48.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:48.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:48.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:49.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:49.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:49.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:49.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:50.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:50.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:50.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:50.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:51.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:51.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:51.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:51.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:52.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:52.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:52.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:52.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:53.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:53.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:53.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:53.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:54.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:54.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:54.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:54.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:55.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:55.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:55.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:55.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:56.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:56.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:56.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:56.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:57.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:57.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:57.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:57.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:58.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:58.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:58.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:58.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:59.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:38:59.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:38:59.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:38:59.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:00.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:00.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:00.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:00.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:01.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:01.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:01.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:01.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:02.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:02.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:02.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:02.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:03.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:03.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:03.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:03.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:04.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:04.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:04.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:04.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:05.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:05.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:05.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:05.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:06.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:06.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:06.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:06.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:07.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:07.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:07.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:07.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:08.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:08.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:08.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:08.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:09.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:09.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:10.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:10.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:10.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:10.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:11.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:11.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:11.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:11.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:12.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:12.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:12.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:12.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:13.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:13.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:13.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:13.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:14.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:14.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:14.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:14.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:15.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:15.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:15.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:15.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:15.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:15.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:16.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:16.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:16.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:16.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:17.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:17.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:17.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:17.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:18.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:18.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:19.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:19.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:19.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:19.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:19.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:19.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:20.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:20.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:20.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:20.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:21.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:21.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:21.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:21.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:22.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:22.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:22.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:22.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:23.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:23.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:23.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:23.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:24.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:24.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:24.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:24.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:25.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:25.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:25.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:25.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:26.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:26.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:26.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:26.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:27.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:27.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:28.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:28.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:28.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:28.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:29.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:29.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:29.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:29.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:30.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:30.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:30.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:30.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:31.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:31.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:31.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:31.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:32.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:32.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:32.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:32.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:32.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:33.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:33.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:34.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:34.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:34.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:34.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:35.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:35.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:35.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:35.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:36.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:36.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:36.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:36.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:37.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:37.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:37.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:37.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:38.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:38.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:38.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:38.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:39.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:39.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:39.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:39.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:40.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:40.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:40.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:40.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:41.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:41.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:41.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:41.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:42.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:42.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:42.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:42.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:43.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:42.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:43.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:43.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:43.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:43.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:44.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:44.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:44.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:44.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:45.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:45.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:45.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:45.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:46.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:46.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:46.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:46.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:47.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:47.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:47.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:47.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:48.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:48.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:48.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:48.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:49.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:49.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:49.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:49.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:50.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:50.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:50.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:50.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:51.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:51.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:51.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:51.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:52.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:52.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:52.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:52.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:53.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:53.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:53.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:53.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:54.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:54.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:54.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:54.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:55.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:55.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:55.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:55.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:56.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:56.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:56.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:56.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:57.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:57.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:57.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:57.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:58.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:58.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:58.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:58.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:59.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:39:59.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:39:59.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:39:59.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:00.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:00.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:00.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:00.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:01.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:01.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:01.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:01.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:02.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:02.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:02.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:02.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:03.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:03.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:03.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:03.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:04.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:04.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:04.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:04.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:05.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:05.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:05.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:05.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:06.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:06.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:06.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:06.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:07.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:07.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:07.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:07.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:08.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:08.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:08.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:08.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:09.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:09.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:09.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:09.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:10.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:10.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:10.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:10.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:11.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:11.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:11.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:11.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:12.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:12.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:12.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:12.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:13.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:13.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:13.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:14.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:14.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:14.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:14.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:15.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:15.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:15.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:15.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:16.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:16.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:16.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:16.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:17.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:17.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:17.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:17.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:18.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:18.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:18.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:18.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:19.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:19.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:19.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:19.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:20.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:20.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:20.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:20.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:21.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:21.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:21.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:21.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:22.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:22.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:22.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:22.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:23.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:23.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:23.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:23.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:24.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:24.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:24.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:24.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:25.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:25.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:25.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:25.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:26.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:26.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:26.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:26.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:27.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:27.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:27.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:27.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:28.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:28.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:28.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:28.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:29.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:29.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:29.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:29.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:30.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:30.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:30.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:30.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:31.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:31.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:31.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:31.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:32.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:32.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:32.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:32.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:33.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:33.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:33.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:33.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:34.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:34.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:34.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:34.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:35.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:35.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:35.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:35.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:36.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:36.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:36.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:36.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:37.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:37.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:37.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:37.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:38.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:38.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:38.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:38.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:39.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:39.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:39.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:39.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:40.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:40.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:40.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:40.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:41.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:41.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:41.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:41.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:42.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:42.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:42.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:42.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:43.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:43.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:43.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:43.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:44.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:44.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:44.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:44.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:45.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:45.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:45.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:45.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:46.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:46.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:46.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:46.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:47.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:47.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:47.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:47.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:48.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:48.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:48.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:48.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:49.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:49.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:49.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:49.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:50.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:50.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:50.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:50.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:51.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:51.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:51.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:51.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:52.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:52.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:52.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:52.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:53.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:53.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:53.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:53.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:54.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:54.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:54.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:54.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:55.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:55.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:55.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:55.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:56.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:56.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:56.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:56.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:57.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:57.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:57.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:57.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:58.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:58.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:58.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:58.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:59.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:40:59.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:40:59.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:40:59.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:00.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:00.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:00.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:00.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:01.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:01.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:01.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:01.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:02.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:02.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:02.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:02.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:03.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:03.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:03.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:03.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:04.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:04.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:04.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:04.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:05.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:05.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:06.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:06.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:06.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:06.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:07.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:07.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:07.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:07.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:08.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:08.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:08.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:08.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:09.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:09.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:09.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:09.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:10.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:10.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:10.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:10.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:11.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:11.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:11.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:11.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:12.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:11.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:12.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:12.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:12.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:12.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:13.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:13.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:13.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:13.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:14.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:14.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:14.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:14.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:15.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:15.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:15.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:15.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:16.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:16.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:16.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:16.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:17.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:17.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:17.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:17.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:18.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:18.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:19.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:19.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:19.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:19.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:20.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:20.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:20.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:20.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:21.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:21.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:21.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:21.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:22.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:22.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:22.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:22.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:23.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:23.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:23.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:23.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:24.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:24.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:24.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:24.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:25.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:25.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:25.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:25.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:26.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:26.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:26.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:26.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:27.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:27.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:27.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:27.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:28.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:28.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:28.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:28.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:29.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:29.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:29.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:29.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:30.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:30.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:30.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:30.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:31.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:31.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:31.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:31.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:32.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:32.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:32.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:32.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:33.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:33.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:33.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:33.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:34.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:34.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:34.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:34.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:35.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:35.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:35.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:35.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:36.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:36.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:36.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:36.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:37.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:37.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:37.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:37.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:38.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:38.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:38.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:38.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:39.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:39.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:39.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:39.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:40.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:40.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:40.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:40.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:41.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:41.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:41.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:41.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:42.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:42.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:42.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:42.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:43.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:43.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:43.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:43.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:44.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:44.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:44.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:44.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:45.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:45.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:45.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:45.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:46.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:46.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:46.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:46.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:47.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:47.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:47.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:47.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:48.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:48.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:48.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:48.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:49.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:49.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:49.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:49.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:50.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:50.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:50.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:50.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:51.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:51.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:51.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:51.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:52.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:52.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:52.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:52.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:53.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:53.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:53.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:53.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:54.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:54.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:54.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:54.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:55.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:55.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:55.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:55.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:56.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:56.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:56.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:56.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:57.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:57.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:57.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:57.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:58.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:58.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:58.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:58.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:59.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:41:59.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:41:59.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:41:59.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:00.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:00.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:00.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:00.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:01.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:01.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:01.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:01.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:02.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:02.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:02.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:02.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:03.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:03.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:03.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:03.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:04.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:04.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:04.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:04.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:05.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:05.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:05.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:05.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:06.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:06.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:06.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:06.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:07.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:07.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:07.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:07.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:08.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:08.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:08.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:08.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:09.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:09.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:09.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:09.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:10.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:10.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:10.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:10.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:11.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:11.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:11.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:11.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:12.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:12.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:12.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:12.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:13.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:13.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:13.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:13.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:14.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:14.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:14.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:14.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:15.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:15.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:15.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:15.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:16.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:16.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:16.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:16.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:17.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:17.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:17.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:17.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:18.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:18.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:18.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:18.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:19.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:19.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:19.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:19.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:20.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:20.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:20.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:20.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:21.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:21.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:21.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:21.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:22.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:22.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:22.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:22.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:23.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:23.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:23.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:23.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:24.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:24.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:24.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:24.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:25.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:25.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:25.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:25.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:26.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:26.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:26.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:26.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:27.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:27.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:27.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:27.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:28.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:28.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:28.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:28.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:29.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:29.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:29.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:29.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:30.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:30.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:30.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:30.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:31.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:31.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:31.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:31.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:32.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:32.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:32.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:32.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:33.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:33.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:33.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:33.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:34.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:34.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:34.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:34.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:35.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:35.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:35.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:35.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:36.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:36.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:36.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:36.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:37.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:37.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:37.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:37.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:38.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:38.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:38.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:38.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:39.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:39.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:39.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:39.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:40.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:40.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:40.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:40.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:41.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:41.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:41.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:41.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:42.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:42.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:42.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:42.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:43.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:43.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:43.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:43.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:44.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:44.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:44.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:44.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:45.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:45.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:45.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:45.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:46.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:46.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:46.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:47.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:47.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:47.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:47.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:48.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:48.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:48.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:48.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:49.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:49.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:49.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:49.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:50.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:50.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:50.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:50.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:51.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:51.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:51.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:51.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:52.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:52.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:52.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:52.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:53.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:53.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:53.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:53.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:54.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:54.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:54.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:54.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:55.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:55.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:55.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:55.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:56.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:56.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:56.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:56.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:57.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:57.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:57.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:57.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:58.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:58.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:58.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:58.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:59.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:42:59.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:42:59.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:42:59.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:00.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:00.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:00.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:00.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:01.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:01.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:01.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:01.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:02.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:02.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:02.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:02.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:03.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:03.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:03.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:03.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:04.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:04.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:04.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:04.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:05.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:05.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:05.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:05.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:06.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:06.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:06.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:06.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:07.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:07.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:07.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:07.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:08.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:08.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:08.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:08.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:09.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:09.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:09.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:09.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:10.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:10.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:10.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:10.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:11.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:11.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:11.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:11.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:12.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:12.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:12.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:12.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:13.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:13.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:13.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:13.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:14.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:14.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:14.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:14.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:15.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:15.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:15.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:15.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:16.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:16.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:16.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:16.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:17.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:17.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:17.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:17.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:18.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:18.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:18.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:18.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:19.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:19.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:19.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:19.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:20.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:20.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:20.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:20.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:21.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:21.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:21.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:21.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:22.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:22.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:22.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:22.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:23.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:23.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:23.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:23.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:24.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:24.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:24.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:24.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:25.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:25.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:25.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:25.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:26.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:26.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:26.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:26.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:27.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:27.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:27.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:27.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:28.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:28.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:28.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:28.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:29.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:29.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:29.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:29.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:30.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:30.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:30.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:30.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:31.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:31.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:31.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:31.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:32.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:32.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:32.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:32.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:33.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:33.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:33.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:33.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:34.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:34.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:34.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:34.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:35.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:35.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:35.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:35.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:36.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:36.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:36.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:36.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:37.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:37.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:37.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:37.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:38.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:38.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:38.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:38.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:39.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:39.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:39.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:39.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:40.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:40.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:40.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:40.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:41.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:41.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:41.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:41.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:42.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:42.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:42.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:42.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:43.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:43.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:43.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:43.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:44.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:44.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:44.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:44.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:45.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:45.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:45.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:45.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:46.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:46.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:46.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:46.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:47.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:47.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:47.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:47.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:48.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:48.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:48.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:48.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:49.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:49.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:49.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:49.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:50.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:50.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:50.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:50.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:51.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:51.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:51.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:51.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:52.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:52.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:52.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:52.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:53.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:53.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:53.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:53.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:54.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:54.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:54.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:55.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:55.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:55.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:55.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:56.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:56.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:56.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:56.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:57.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:57.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:57.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:57.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:58.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:58.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:58.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:58.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:59.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:43:59.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:43:59.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:43:59.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:00.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:00.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:00.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:00.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:01.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:01.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:01.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:01.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:02.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:02.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:02.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:02.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:03.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:03.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:03.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:03.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:04.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:04.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:04.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:04.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:05.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:05.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:05.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:05.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:06.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:06.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:06.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:06.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:07.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:07.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:07.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:07.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:08.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:08.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:08.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:08.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:09.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:09.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:09.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:09.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:10.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:10.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:10.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:10.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:11.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:11.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:11.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:11.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:12.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:12.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:12.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:12.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:13.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:13.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:13.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:13.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:14.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:14.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:15.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:15.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:15.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:15.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:16.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:16.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:16.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:16.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:17.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:17.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:17.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:18.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:18.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:18.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:18.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:19.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:19.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:19.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:19.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:20.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:20.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:20.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:20.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:21.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:21.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:21.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:21.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:22.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:22.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:22.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:22.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:23.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:23.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:23.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:23.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:23.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:23.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:24.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:24.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:24.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:24.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:25.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:25.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:25.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:25.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:26.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:26.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:26.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:26.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:27.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:27.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:27.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:27.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:28.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:28.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:28.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:28.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:29.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:29.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:29.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:29.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:30.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:30.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:30.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:30.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:31.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:31.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:32.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:32.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:32.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:32.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:33.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:33.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:33.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:33.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:34.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:34.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:34.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:34.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:35.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:35.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:35.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:35.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:36.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:36.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:36.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:36.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:37.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:37.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:37.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:37.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:38.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:38.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:38.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:38.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:39.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:39.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:39.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:39.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:40.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:40.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:40.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:40.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:41.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:41.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:41.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:41.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:42.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:42.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:42.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:42.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:43.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:43.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:43.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:43.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:44.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:44.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:44.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:44.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:45.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:45.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:45.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:45.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:46.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:46.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:46.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:46.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:47.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:47.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:47.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:47.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:48.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:48.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:48.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:48.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:49.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:49.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:49.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:49.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:50.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:50.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:50.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:50.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:51.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:51.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:51.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:51.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:52.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:52.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:52.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:52.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:52.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:52.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:53.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:53.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:54.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:54.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:54.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:54.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:55.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:55.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:55.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:55.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:56.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:56.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:56.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:56.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:57.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:57.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:57.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:57.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:57.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:57.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:58.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:58.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:58.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:58.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:59.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:44:59.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:44:59.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:44:59.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:00.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:00.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:00.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:00.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:01.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:01.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:01.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:01.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:02.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:02.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:02.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:02.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:03.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:03.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:03.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:03.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:04.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:04.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:04.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:04.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:05.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:05.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:05.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:05.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:06.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:06.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:06.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:06.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:07.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:07.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:07.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:07.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:08.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:08.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:08.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:08.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:09.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:09.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:09.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:09.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:10.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:10.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:10.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:10.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:11.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:11.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:11.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:11.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:12.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:12.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:12.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:12.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:13.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:13.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:13.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:13.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:14.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:14.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:14.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:14.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:15.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:15.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:15.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:15.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:16.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:16.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:16.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:16.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:17.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:17.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:17.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:17.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:18.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:18.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:18.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:18.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:19.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:19.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:19.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:19.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:20.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:20.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:20.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:20.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:21.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:21.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:21.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:21.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:22.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:22.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:22.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:22.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:23.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:23.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:23.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:23.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:24.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:24.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:24.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:24.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:25.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:25.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:25.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:25.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:26.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:26.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:26.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:26.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:27.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:27.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:27.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:27.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:28.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:28.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:28.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:28.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:29.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:29.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:29.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:29.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:30.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:30.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:30.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:30.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:31.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:31.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:31.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:31.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:32.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:32.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:32.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:32.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:33.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:33.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:33.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:33.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:34.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:34.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:34.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:34.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:35.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:35.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:35.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:35.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:36.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:36.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:36.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:36.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:37.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:37.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:37.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:37.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:38.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:38.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:38.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:38.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:39.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:39.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:39.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:39.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:40.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:40.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:40.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:40.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:41.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:41.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:41.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:41.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:42.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:42.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:42.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:42.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:43.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:43.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:43.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:43.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:44.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:44.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:44.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:44.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:45.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:45.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:45.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:45.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:46.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:46.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:46.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:46.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:47.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:47.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:47.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:47.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:48.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:48.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:48.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:48.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:49.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:49.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:50.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:50.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:50.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:50.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:51.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:51.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:51.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:51.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:52.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:52.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:52.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:52.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:53.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:53.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:53.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:53.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:54.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:54.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:54.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:54.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:55.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:55.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:55.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:55.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:56.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:56.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:56.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:56.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:57.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:57.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:57.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:57.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:58.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:58.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:58.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:58.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:59.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:45:59.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:45:59.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:45:59.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:00.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:00.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:00.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:00.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:01.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:01.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:01.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:01.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:02.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:02.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:02.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:02.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:03.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:03.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:03.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:03.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:04.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:04.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:04.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:04.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:05.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:05.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:05.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:05.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:06.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:06.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:06.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:06.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:07.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:07.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:07.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:07.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:08.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:08.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:08.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:08.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:09.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:09.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:09.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:09.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:10.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:10.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:10.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:10.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:11.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:11.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:11.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:11.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:12.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:12.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:12.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:12.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:13.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:13.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:13.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:13.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:14.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:14.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:14.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:14.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:15.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:15.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:15.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:15.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:16.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:16.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:16.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:16.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:17.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:17.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:17.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:17.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:18.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:18.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:18.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:18.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:19.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:19.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:19.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:19.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:20.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:20.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:20.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:20.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:21.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:21.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:21.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:21.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:22.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:22.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:22.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:22.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:23.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:23.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:23.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:23.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:24.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:24.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:24.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:24.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:25.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:25.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:25.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:25.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:25.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:25.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:26.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:26.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:27.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:27.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:27.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:27.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:27.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:27.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:28.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:28.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:28.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:28.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:29.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:29.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:29.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:29.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:30.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:30.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:30.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:30.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:31.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:31.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:31.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:31.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:32.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:32.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:33.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:33.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:33.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:33.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:34.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:34.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:34.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:34.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:34.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:34.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:35.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:35.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:35.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:35.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:36.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:36.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:37.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:37.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:37.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:37.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:37.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:37.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:38.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:38.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:38.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:38.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:39.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:39.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:40.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:39.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:40.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:40.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:41.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:41.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:41.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:41.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:42.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:42.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:42.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:42.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:43.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:43.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:43.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:43.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:44.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:44.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:44.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:44.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:45.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:45.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:45.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:45.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:46.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:46.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:46.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:46.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:47.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:47.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:47.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:47.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:48.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:48.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:48.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:48.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:49.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:49.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:49.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:49.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:50.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:50.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:50.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:50.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:51.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:51.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:51.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:51.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:52.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:52.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:52.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:52.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:53.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:53.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:53.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:53.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:54.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:54.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:54.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:54.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:55.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:55.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:55.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:55.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:56.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:56.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:56.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:56.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:57.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:57.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:57.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:57.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:58.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:58.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:58.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:58.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:59.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:46:59.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:46:59.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:46:59.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:00.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:00.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:00.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:00.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:01.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:01.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:01.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:01.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:02.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:02.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:02.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:02.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:03.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:03.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:03.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:03.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:04.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:04.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:04.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:04.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:05.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:05.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:05.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:05.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:06.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:06.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:06.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:06.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:07.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:07.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:07.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:07.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:07.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:07.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:08.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:08.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:08.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:08.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:09.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:09.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:09.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:09.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:10.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:10.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:10.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:10.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:11.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:11.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:11.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:11.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:12.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:12.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:12.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:12.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:13.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:13.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:13.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:13.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:14.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:14.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:14.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:14.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:15.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:15.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:15.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:15.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:16.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:16.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:16.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:16.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:17.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:17.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:17.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:17.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:18.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:18.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:18.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:18.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:19.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:19.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:19.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:19.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:20.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:20.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:20.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:20.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:21.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:21.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:21.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:21.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:22.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:22.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:22.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:22.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:23.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:23.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:23.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:23.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:24.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:24.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:24.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:24.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:25.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:25.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:25.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:25.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:26.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:26.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:26.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:26.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:27.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:27.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:27.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:27.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:28.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:28.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:28.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:28.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:29.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:29.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:29.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:29.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:30.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:30.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:30.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:30.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:31.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:31.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:31.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:31.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:32.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:32.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:32.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:32.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:33.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:33.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:33.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:33.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:34.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:34.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:34.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:34.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:35.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:35.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:35.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:35.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:36.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:36.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:36.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:36.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:37.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:37.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:37.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:37.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:38.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:38.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:38.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:38.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:39.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:39.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:39.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:39.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:40.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:40.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:40.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:40.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:41.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:41.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:41.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:41.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:42.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:42.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:42.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:42.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:43.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:43.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:43.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:43.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:44.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:44.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:44.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:44.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:45.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:45.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:45.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:45.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:46.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:46.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:46.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:46.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:47.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:47.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:47.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:47.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:48.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:48.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:48.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:48.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:49.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:49.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:49.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:49.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:50.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:50.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:50.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:51.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:51.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:51.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:51.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:52.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:52.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:52.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:52.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:53.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:53.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:53.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:53.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:54.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:54.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:54.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:54.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:55.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:55.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:55.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:55.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:56.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:56.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:56.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:56.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:57.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:57.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:57.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:57.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:58.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:58.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:58.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:58.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:59.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:47:59.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:47:59.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:47:59.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:00.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:00.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:00.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:00.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:01.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:01.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:01.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:01.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:02.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:02.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:02.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:02.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:03.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:03.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:03.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:03.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:04.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:04.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:04.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:04.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:05.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:05.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:05.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:05.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:06.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:06.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:06.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:06.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:07.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:07.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:07.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:07.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:08.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:08.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:08.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:08.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:09.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:09.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:09.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:09.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:10.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:10.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:10.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:10.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:11.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:11.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:11.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:11.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:12.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:12.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:12.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:12.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:13.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:13.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:13.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:13.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:15.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:15.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:15.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:15.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:16.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:16.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:16.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:16.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:16.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:16.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:17.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:17.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:17.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:17.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:18.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:18.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:19.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:19.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:19.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:19.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:20.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:20.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:20.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:20.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:21.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:21.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:21.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:21.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:22.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:22.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:22.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:22.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:23.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:23.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:23.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:23.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:24.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:24.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:24.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:24.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:25.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:25.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:25.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:25.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:26.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:26.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:26.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:26.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:27.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:27.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:27.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:27.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:28.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:28.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:28.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:28.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:29.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:29.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:29.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:29.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:30.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:30.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:30.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:30.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:30.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:30.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:31.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:30.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:31.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:31.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:31.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:31.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:32.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:32.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:32.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:32.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:33.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:33.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:33.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:33.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:34.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:34.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:34.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:34.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:35.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:35.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:35.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:35.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:36.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:36.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:36.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:36.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:37.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:37.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:37.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:37.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:38.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:38.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:39.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:39.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:39.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:39.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:40.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:40.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:41.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:41.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:41.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:41.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:41.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:41.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:42.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:42.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:43.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:43.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:43.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:43.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:43.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:43.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:44.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:44.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:45.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:45.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:45.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:45.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:46.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:46.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:46.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:46.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:46.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:46.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:47.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:47.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:47.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:47.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:48.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:48.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:48.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:48.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:49.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:49.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:49.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:49.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:50.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:50.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:50.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:50.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:51.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:51.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:51.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:51.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:52.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:52.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:52.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:52.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:53.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:53.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:53.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:53.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:54.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:54.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:54.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:54.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:55.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:55.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:55.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:55.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:56.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:56.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:57.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:57.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:57.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:57.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:57.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:57.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:58.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:58.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:58.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:58.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:59.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:48:59.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:48:59.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:48:59.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:00.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:00.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:00.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:00.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:01.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:01.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:01.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:01.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:02.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:02.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:03.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:03.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:03.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:03.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:03.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:03.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:04.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:04.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:04.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:04.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:05.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:05.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:05.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:05.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:06.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:06.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:06.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:06.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:07.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:07.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:08.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:08.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:08.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:08.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:08.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:08.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:09.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:09.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:09.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:09.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:10.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:10.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:10.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:10.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:11.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:11.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:11.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:11.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:12.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:12.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:12.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:12.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:13.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:13.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:13.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:13.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:14.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:14.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:14.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:14.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:15.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:15.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:15.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:15.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:16.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:16.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:16.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:16.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:17.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:17.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:17.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:17.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:18.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:18.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:18.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:18.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:19.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:19.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:19.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:19.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:20.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:20.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:21.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:21.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:21.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:21.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:21.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:21.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:22.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:22.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:22.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:22.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:23.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:23.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:23.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:23.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:24.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:24.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:24.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:24.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:25.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:25.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:25.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:25.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:26.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:26.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:26.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:26.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:27.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:27.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:27.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:27.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:28.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:28.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:28.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:28.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:29.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:29.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:29.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:29.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:30.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:30.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:31.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:31.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:31.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:31.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:32.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:32.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:32.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:32.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:33.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:33.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:33.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:33.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:33.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:33.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:34.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:34.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:34.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:34.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:35.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:35.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:35.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:35.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:36.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:36.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:36.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:36.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:37.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:37.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:37.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:37.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:38.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:38.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:39.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:39.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:39.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:39.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:40.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:40.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:40.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:40.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:41.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:41.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:41.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:41.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:42.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:42.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:42.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:42.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:43.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:43.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:43.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:43.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:44.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:44.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:44.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:44.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:45.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:45.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:45.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:45.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:46.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:46.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:46.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:47.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:47.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:47.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:47.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:48.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:48.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:48.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:49.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:49.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:49.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:49.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:50.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:50.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:50.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:50.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:51.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:51.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:51.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:51.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:52.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:52.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:52.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:52.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:53.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:53.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:53.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:53.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:54.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:54.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:54.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:54.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:55.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:55.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:55.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:55.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:56.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:56.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:56.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:56.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:57.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:57.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:57.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:57.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:58.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:58.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:58.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:58.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:59.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:49:59.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:49:59.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:49:59.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:00.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:00.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:00.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:00.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:01.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:01.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:01.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:01.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:02.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:02.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:02.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:02.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:03.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:03.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:03.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:03.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:04.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:04.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:04.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:04.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:05.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:05.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:05.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:05.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:06.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:06.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:06.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:06.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:07.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:07.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:07.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:07.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:08.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:08.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:08.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:08.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:09.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:09.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:09.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:09.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:10.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:10.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:10.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:10.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:11.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:11.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:11.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:11.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:12.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:12.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:12.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:12.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:13.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:13.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:13.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:13.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:14.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:14.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:14.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:14.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:15.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:15.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:15.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:15.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:16.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:16.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:16.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:16.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:17.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:17.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:17.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:17.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:18.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:18.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:18.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:18.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:19.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:19.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:19.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:19.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:20.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:20.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:20.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:20.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:21.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:21.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:21.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:21.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:22.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:22.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:22.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:22.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:23.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:23.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:23.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:23.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:24.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:24.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:24.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:24.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:25.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:25.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:25.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:25.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:26.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:26.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:26.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:26.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:27.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:27.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:27.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:27.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:28.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:28.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:28.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:28.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:29.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:29.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:29.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:29.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:30.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:30.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:30.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:30.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:31.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:31.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:31.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:31.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:32.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:32.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:32.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:32.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:33.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:33.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:33.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:33.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:34.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:34.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:34.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:34.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:34.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:34.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:35.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:35.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:35.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:35.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:36.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:36.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:36.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:36.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:37.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:37.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:37.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:37.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:38.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:38.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:38.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:38.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:39.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:39.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:39.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:39.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:40.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:40.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:40.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:40.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:41.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:41.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:41.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:41.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:42.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:42.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:42.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:42.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:43.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:43.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:43.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:43.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:44.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:44.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:44.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:44.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:45.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:45.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:45.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:45.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:46.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:46.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:46.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:46.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:47.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:47.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:47.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:47.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:48.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:48.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:48.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:48.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:49.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:49.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:49.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:49.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:50.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:50.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:50.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:50.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:51.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:51.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:51.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:51.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:52.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:52.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:52.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:52.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:53.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:53.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:53.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:53.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:54.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:54.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:54.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:54.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:55.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:55.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:55.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:55.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:56.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:56.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:56.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:56.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:57.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:57.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:57.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:57.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:58.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:58.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:58.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:58.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:59.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:50:59.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:50:59.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:50:59.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:00.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:00.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:01.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:01.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:01.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:01.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:02.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:02.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:02.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:02.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:03.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:03.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:03.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:03.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:04.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:03.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:04.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:04.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:04.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:04.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:05.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:05.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:05.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:05.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:06.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:06.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:06.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:06.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:07.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:07.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:08.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:08.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:08.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:08.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:08.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:08.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:09.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:09.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:10.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:10.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:10.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:10.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:11.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:11.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:11.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:11.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:12.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:12.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:12.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:12.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:12.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:12.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:13.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:13.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:13.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:13.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:14.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:14.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:14.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:14.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:15.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:15.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:15.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:15.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:16.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:16.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:17.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:17.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:17.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:17.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:18.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:18.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:18.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:18.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:19.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:19.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:19.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:19.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:20.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:20.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:20.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:20.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:20.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:20.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:21.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:21.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:21.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:21.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:22.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:22.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:22.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:22.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:23.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:23.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:23.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:23.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:24.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:24.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:24.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:24.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:25.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:25.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:25.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:25.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:26.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:26.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:26.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:26.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:27.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:27.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:27.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:27.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:28.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:28.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:28.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:28.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:29.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:29.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:29.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:29.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:30.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:30.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:30.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:30.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:31.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:31.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:31.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:31.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:32.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:32.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:32.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:32.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:33.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:33.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:33.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:33.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:34.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:34.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:34.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:34.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:35.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:35.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:35.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:35.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:36.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:36.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:36.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:36.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:37.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:37.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:37.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:37.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:38.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:38.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:38.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:38.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:39.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:39.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:39.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:39.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:40.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:40.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:40.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:40.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:41.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:41.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:41.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:41.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:42.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:42.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:42.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:42.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:43.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:43.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:43.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:43.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:44.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:44.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:45.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:45.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:45.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:45.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:45.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:45.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:46.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:46.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:47.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:47.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:47.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:47.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:48.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:48.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:48.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:48.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:49.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:49.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:49.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:49.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:50.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:50.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:50.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:50.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:51.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:51.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:51.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:51.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:52.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:52.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:52.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:52.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:53.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:53.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:53.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:53.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:54.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:54.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:54.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:54.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:55.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:55.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:55.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:55.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:55.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:55.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:56.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:56.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:56.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:56.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:57.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:57.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:58.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:58.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:58.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:58.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:58.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:58.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:59.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:51:59.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:51:59.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:51:59.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:00.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:00.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:00.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:00.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:01.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:01.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:01.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:01.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:02.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:02.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:02.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:02.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:03.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:03.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:03.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:03.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:04.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:04.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:04.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:04.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:05.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:05.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:05.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:05.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:06.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:06.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:06.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:06.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:07.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:07.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:08.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:08.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:08.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:08.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:09.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:09.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:09.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:09.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:10.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:10.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:10.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:10.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:11.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:11.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:11.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:11.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:11.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:11.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:12.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:12.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:12.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:12.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:13.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:13.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:13.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:13.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:14.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:14.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:14.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:14.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:15.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:15.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:15.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:15.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:16.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:16.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:16.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:16.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:17.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:17.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:17.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:17.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:18.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:18.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:18.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:18.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:19.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:19.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:19.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:19.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:20.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:20.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:20.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:20.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:21.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:21.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:21.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:21.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:22.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:22.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:22.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:22.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:23.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:23.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:23.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:23.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:24.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:24.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:24.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:24.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:25.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:25.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:25.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:25.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:26.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:26.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:26.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:26.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:27.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:27.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:27.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:27.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:28.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:28.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:28.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:28.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:29.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:29.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:29.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:29.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:30.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:30.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:30.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:30.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:31.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:31.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:31.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:31.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:32.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:32.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:32.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:32.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:33.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:33.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:33.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:33.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:34.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:34.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:34.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:34.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:35.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:35.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:35.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:35.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:36.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:36.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:36.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:36.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:37.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:37.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:37.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:37.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:38.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:38.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:38.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:38.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:39.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:39.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:39.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:39.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:40.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:40.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:40.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:40.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:41.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:41.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:41.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:41.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:42.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:42.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:42.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:42.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:43.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:43.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:43.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:43.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:44.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:44.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:44.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:44.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:45.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:45.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:45.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:45.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:46.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:46.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:46.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:46.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:47.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:47.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:47.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:47.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:48.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:48.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:48.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:48.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:49.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:49.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:49.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:49.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:50.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:50.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:50.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:50.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:51.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:51.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:51.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:51.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:52.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:52.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:52.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:52.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:53.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:53.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:53.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:53.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:54.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:54.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:54.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:54.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:55.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:55.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:55.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:55.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:56.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:56.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:56.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:56.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:57.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:57.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:57.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:57.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:58.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:58.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:58.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:58.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:59.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:52:59.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:52:59.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:52:59.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:00.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:00.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:00.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:00.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:01.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:01.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:01.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:01.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:02.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:02.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:02.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:02.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:03.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:03.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:03.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:03.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:04.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:04.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:04.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:04.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:05.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:05.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:05.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:05.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:06.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:06.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:07.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:07.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:07.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:07.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:08.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:08.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:08.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:08.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:09.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:09.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:09.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:09.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:10.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:10.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:10.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:10.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:10.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:10.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:11.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:11.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:12.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:12.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:12.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:12.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:13.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:12.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:13.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:13.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:14.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:14.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:14.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:14.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:15.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:15.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:15.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:15.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:16.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:16.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:16.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:16.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:17.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:17.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:17.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:17.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:18.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:18.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:18.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:18.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:19.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:19.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:19.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:19.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:20.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:20.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:20.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:20.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:21.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:21.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:21.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:21.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:22.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:22.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:22.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:22.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:23.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:23.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:23.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:23.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:24.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:24.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:24.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:24.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:25.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:25.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:25.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:25.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:26.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:26.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:26.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:26.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:27.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:27.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:27.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:27.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:28.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:28.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:28.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:28.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:29.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:29.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:29.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:29.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:30.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:30.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:30.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:30.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:31.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:31.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:31.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:31.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:32.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:32.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:32.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:32.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:33.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:33.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:33.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:33.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:34.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:34.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:34.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:34.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:35.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:35.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:35.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:35.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:36.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:36.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:36.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:36.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:37.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:37.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:37.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:37.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:38.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:38.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:38.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:38.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:39.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:39.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:39.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:39.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:40.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:40.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:40.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:40.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:41.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:41.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:41.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:41.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:42.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:42.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:42.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:42.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:43.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:43.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:43.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:43.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:44.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:44.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:44.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:44.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:45.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:45.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:45.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:45.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:46.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:46.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:46.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:46.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:47.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:47.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:47.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:47.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:48.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:48.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:48.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:48.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:49.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:49.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:49.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:49.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:50.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:50.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:50.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:50.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:51.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:51.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:51.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:51.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:52.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:52.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:52.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:52.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:53.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:53.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:53.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:53.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:54.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:54.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:54.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:54.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:55.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:55.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:55.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:55.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:56.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:56.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:56.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:56.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:57.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:57.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:57.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:57.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:58.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:58.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:58.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:58.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:59.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:53:59.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:53:59.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:53:59.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:00.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:00.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:00.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:00.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:01.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:01.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:01.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:01.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:02.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:02.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:02.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:02.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:03.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:03.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:03.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:03.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:04.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:04.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:04.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:04.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:05.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:05.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:05.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:05.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:06.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:06.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:06.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:06.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:07.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:07.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:07.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:07.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:08.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:08.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:08.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:08.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:09.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:09.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:09.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:09.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:10.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:10.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:10.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:10.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:11.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:11.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:11.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:11.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:12.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:12.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:12.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:12.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:13.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:13.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:13.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:13.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:14.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:14.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:14.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:14.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:15.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:15.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:15.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:15.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:16.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:16.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:17.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:17.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:17.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:17.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:18.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:18.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:18.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:18.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:18.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:18.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:19.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:19.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:20.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:20.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:20.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:20.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:21.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:21.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:21.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:21.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:22.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:22.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:22.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:22.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:22.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:22.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:23.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:23.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:23.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:23.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:24.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:24.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:25.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:25.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:25.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:25.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:26.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:26.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:26.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:26.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:27.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:27.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:27.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:27.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:27.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:27.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:28.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:28.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:29.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:29.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:29.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:29.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:29.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:29.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:30.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:30.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:31.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:31.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:31.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:31.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:32.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:32.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:32.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:32.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:33.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:33.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:33.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:33.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:34.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:34.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:34.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:34.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:35.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:35.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:35.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:35.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:36.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:36.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:36.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:36.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:37.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:37.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:37.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:37.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:38.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:38.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:38.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:38.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:39.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:39.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:39.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:39.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:40.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:40.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:40.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:40.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:41.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:41.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:41.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:41.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:42.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:42.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:42.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:42.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:43.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:43.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:43.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:43.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:44.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:44.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:44.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:44.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:45.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:45.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:45.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:45.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:46.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:46.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:46.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:46.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:47.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:47.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:47.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:47.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:48.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:48.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:48.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:48.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:49.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:49.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:49.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:49.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:50.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:50.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:50.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:50.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:51.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:51.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:51.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:51.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:52.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:52.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:52.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:52.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:53.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:53.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:53.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:53.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:54.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:54.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:54.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:54.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:55.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:55.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:55.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:55.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:56.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:56.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:56.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:56.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:57.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:57.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:57.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:57.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:58.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:58.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:58.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:58.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:59.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:54:59.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:54:59.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:54:59.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:00.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:00.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:00.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:00.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:01.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:01.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:01.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:01.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:02.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:02.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:02.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:02.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:03.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:03.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:03.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:03.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:04.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:04.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:04.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:04.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:05.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:05.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:05.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:05.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:06.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:06.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:06.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:06.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:07.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:07.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:07.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:07.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:08.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:08.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:08.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:08.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:09.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:09.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:09.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:09.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:10.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:10.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:10.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:10.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:11.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:11.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:11.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:11.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:12.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:12.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:12.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:12.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:13.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:13.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:13.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:13.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:14.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:14.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:14.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:14.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:15.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:15.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:15.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:15.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:16.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:16.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:16.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:16.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:17.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:17.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:17.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:17.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:18.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:18.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:18.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:18.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:19.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:19.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:19.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:19.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:20.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:20.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:20.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:20.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:21.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:21.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:21.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:21.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:22.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:22.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:22.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:22.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:23.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:23.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:23.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:23.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:24.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:24.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:24.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:24.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:25.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:25.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:25.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:25.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:26.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:26.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:26.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:26.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:27.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:27.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:27.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:27.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:28.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:28.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:28.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:28.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:29.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:29.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:29.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:29.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:30.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:30.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:30.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:30.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:31.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:31.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:31.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:31.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:32.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:32.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:32.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:32.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:33.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:33.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:33.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:33.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:34.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:34.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:34.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:34.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:35.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:35.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:35.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:35.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:36.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:36.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:36.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:36.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:37.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:37.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:37.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:37.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:38.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:38.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:38.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:38.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:39.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:39.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:39.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:39.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:40.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:40.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:40.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:40.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:41.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:41.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:41.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:41.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:42.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:42.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:42.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:42.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:43.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:43.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:43.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:43.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:44.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:44.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:44.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:44.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:45.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:45.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:45.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:45.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:46.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:46.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:46.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:46.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:47.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:47.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:47.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:47.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:48.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:48.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:48.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:48.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:49.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:49.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:49.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:49.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:50.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:50.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:50.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:50.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:51.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:51.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:51.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:51.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:52.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:52.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:52.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:52.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:53.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:53.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:53.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:53.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:54.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:54.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:54.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:54.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:55.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:55.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:55.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:55.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:56.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:55.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:56.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:56.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:57.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:57.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:57.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:57.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:58.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:58.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:58.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:58.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:59.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:55:59.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:55:59.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:55:59.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:00.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:00.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:00.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:00.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:01.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:01.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:01.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:01.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:01.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:01.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:02.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:02.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:02.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:02.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:03.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:03.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:03.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:03.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:04.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:04.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:04.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:04.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:05.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:05.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:05.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:05.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:06.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:06.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:06.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:06.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:07.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:07.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:07.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:07.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:08.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:08.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:08.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:08.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:09.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:09.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:09.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:09.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:10.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:10.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:10.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:10.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:11.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:11.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:11.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:11.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:12.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:12.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:12.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:12.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:13.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:13.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:14.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:14.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:14.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:14.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:14.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:14.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:15.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:15.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:16.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:16.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:16.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:16.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:16.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:16.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:17.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:17.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:17.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:17.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:18.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:18.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:18.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:18.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:19.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:19.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:19.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:19.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:20.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:20.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:20.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:20.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:21.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:21.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:21.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:21.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:22.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:22.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:22.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:22.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:23.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:23.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:23.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:23.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:24.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:24.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:24.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:24.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:24.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:24.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:25.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:25.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:25.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:25.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:26.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:26.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:26.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:26.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:27.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:27.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:28.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:28.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:28.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:28.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:29.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:29.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:29.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:29.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:30.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:30.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:30.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:30.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:31.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:31.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:31.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:31.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:32.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:32.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:32.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:32.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:33.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:33.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:33.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:33.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:34.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:34.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:34.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:34.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:35.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:35.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:35.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:35.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:36.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:36.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:36.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:36.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:37.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:37.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:37.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:37.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:38.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:38.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:38.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:38.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:39.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:39.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:39.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:39.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:40.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:40.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:40.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:40.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:41.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:41.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:41.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:41.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:42.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:42.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:42.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:42.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:43.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:43.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:43.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:43.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:44.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:44.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:44.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:44.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:45.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:45.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:45.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:45.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:46.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:46.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:46.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:46.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:47.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:47.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:47.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:47.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:48.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:48.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:48.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:48.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:49.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:49.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:49.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:49.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:50.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:50.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:50.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:50.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:51.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:51.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:51.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:51.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:52.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:52.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:52.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:52.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:53.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:53.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:53.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:53.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:54.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:54.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:54.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:54.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:55.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:55.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:55.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:55.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:56.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:56.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:56.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:56.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:57.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:57.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:57.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:57.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:58.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:58.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:58.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:58.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:59.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:56:59.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:56:59.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:56:59.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:00.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:00.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:00.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:00.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:01.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:01.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:01.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:01.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:02.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:02.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:02.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:02.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:03.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:03.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:03.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:03.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:04.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:04.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:04.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:04.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:05.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:05.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:05.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:05.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:06.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:06.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:06.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:06.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:07.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:07.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:07.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:07.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:08.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:08.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:08.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:08.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:09.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:09.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:09.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:09.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:10.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:10.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:10.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:10.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:11.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:11.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:11.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:11.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:12.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:12.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:12.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:12.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:13.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:13.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:13.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:13.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:14.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:14.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:14.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:14.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:15.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:15.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:15.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:15.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:16.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:16.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:16.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:16.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:17.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:17.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:17.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:17.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:18.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:18.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:18.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:18.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:19.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:19.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:19.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:19.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:20.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:20.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:20.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:20.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:21.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:21.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:21.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:21.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:22.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:22.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:22.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:22.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:23.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:23.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:23.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:23.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:24.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:24.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:24.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:24.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:25.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:25.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:25.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:25.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:26.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:26.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:26.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:26.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:27.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:27.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:27.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:27.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:28.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:28.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:28.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:28.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:29.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:29.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:29.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:29.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:30.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:30.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:31.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:31.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:31.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:31.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:32.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:32.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:32.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:32.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:33.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:33.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:33.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:33.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:34.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:34.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:34.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:34.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:35.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:35.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:35.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:35.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:36.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:36.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:36.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:36.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:37.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:37.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:37.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:37.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:38.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:38.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:38.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:38.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:39.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:39.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:39.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:39.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:39.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:39.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:40.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:40.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:40.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:40.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:41.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:41.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:41.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:41.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:42.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:42.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:43.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:43.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:43.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:43.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:44.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:44.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:44.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:44.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:45.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:45.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:45.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:45.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:46.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:46.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:46.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:46.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:47.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:47.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:47.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:47.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:48.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:48.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:48.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:48.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:49.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:49.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:49.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:49.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:50.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:50.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:50.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:50.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:51.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:51.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:51.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:51.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:52.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:52.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:52.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:52.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:53.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:53.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:53.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:53.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:54.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:54.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:54.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:54.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:55.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:55.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:55.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:55.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:56.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:56.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:56.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:56.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:57.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:57.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:57.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:57.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:58.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:58.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:58.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:58.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:59.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:57:59.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:57:59.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:57:59.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:00.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:00.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:00.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:00.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:01.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:01.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:01.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:01.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:02.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:02.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:02.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:02.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:03.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:03.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:03.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:03.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:04.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:04.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:04.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:04.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:05.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:05.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:05.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:05.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:06.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:06.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:06.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:06.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:07.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:07.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:07.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:07.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:08.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:08.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:08.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:08.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:09.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:09.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:09.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:09.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:10.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:10.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:10.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:10.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:11.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:11.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:11.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:11.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:12.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:12.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:12.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:12.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:13.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:13.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:13.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:13.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:14.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:14.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:14.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:14.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:15.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:15.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:15.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:15.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:16.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:16.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:16.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:16.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:17.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:17.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:17.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:17.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:18.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:18.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:18.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:18.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:19.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:19.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:19.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:19.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:20.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:20.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:20.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:20.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:21.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:21.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:21.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:21.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:22.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:22.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:22.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:22.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:23.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:23.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:23.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:23.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:24.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:24.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:24.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:24.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:25.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:25.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:25.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:25.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:26.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:26.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:26.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:26.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:27.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:27.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:27.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:27.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:28.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:28.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:28.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:28.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:29.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:29.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:29.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:29.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:30.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:30.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:30.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:30.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:31.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:31.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:31.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:31.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:32.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:32.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:32.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:32.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:33.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:33.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:33.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:33.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:34.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:34.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:34.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:34.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:35.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:35.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:35.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:35.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:36.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:36.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:36.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:36.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:37.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:37.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:37.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:37.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:38.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:38.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:38.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:38.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:39.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:39.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:39.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:39.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:40.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:40.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:40.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:40.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:41.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:41.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:41.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:41.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:42.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:42.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:42.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:42.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:43.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:43.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:43.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:43.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:44.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:44.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:44.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:44.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:45.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:45.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:45.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:45.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:46.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:46.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:46.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:46.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:47.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:47.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:47.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:47.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:48.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:48.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:48.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:48.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:49.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:49.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:49.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:49.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:50.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:50.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:50.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:50.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:51.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:51.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:51.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:51.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:52.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:52.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:52.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:52.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:53.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:53.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:53.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:53.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:54.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:54.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:54.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:54.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:55.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:55.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:55.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:55.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:56.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:56.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:56.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:56.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:57.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:57.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:57.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:57.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:58.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:58.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:58.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:58.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:59.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:58:59.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:58:59.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:58:59.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:00.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:00.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:00.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:00.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:01.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:01.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:01.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:01.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:02.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:02.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:02.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:02.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:03.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:03.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:03.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:03.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:04.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:04.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:04.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:04.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:05.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:05.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:05.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:05.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:06.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:06.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:06.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:06.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:07.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:07.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:07.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:07.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:08.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:08.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:08.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:08.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:09.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:09.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:09.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:09.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:10.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:10.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:10.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:10.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:11.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:11.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:11.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:11.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:12.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:12.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:12.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:12.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:13.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:13.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:13.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:13.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:14.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:14.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:14.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:14.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:15.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:15.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:15.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:15.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:16.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:16.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:16.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:16.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:17.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:17.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:17.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:17.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:18.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:18.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:18.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:18.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:19.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:19.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:19.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:19.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:20.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:20.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:20.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:20.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:21.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:21.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:21.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:21.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:22.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:22.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:22.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:22.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:23.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:23.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:23.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:23.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:24.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:24.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:24.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:24.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:25.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:25.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:25.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:25.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:26.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:26.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:26.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:26.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:27.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:27.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:27.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:27.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:28.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:28.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:28.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:28.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:29.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:29.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:29.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:29.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:30.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:30.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:30.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:30.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:31.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:31.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:31.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:31.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:32.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:32.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:32.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:32.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:33.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:33.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:33.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:33.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:34.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:34.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:34.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:34.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:35.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:35.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:35.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:35.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:36.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:36.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:36.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:36.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:37.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:37.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:37.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:37.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:38.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:38.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:38.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:38.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:39.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:39.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:39.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:39.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:40.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:40.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:40.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:40.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:41.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:41.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:41.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:41.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:42.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:42.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:42.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:42.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:43.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:43.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:43.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:43.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:44.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:44.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:44.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:44.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:45.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:45.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:45.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:45.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:46.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:46.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:46.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:46.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:47.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:47.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:47.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:47.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:48.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:48.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:48.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:48.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:49.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:49.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:49.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:49.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:50.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:50.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:50.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:50.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:51.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:51.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:51.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:51.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:52.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:52.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:52.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:52.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:53.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:53.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:53.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:53.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:54.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:54.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:54.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:54.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:55.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:55.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:55.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:55.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:56.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:56.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:56.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:56.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:57.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:57.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:57.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:57.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:58.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:58.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:58.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:58.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:59.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T20:59:59.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T20:59:59.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T20:59:59.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:00.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:00.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:00.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:00.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:01.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:01.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:01.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:01.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:02.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:02.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:02.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:02.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:03.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:03.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:03.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:03.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:04.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:04.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:04.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:04.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:05.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:05.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:05.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:05.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:06.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:06.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:06.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:06.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:07.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:07.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:07.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:07.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:08.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:08.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:08.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:08.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:09.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:09.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:09.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:09.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:10.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:10.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:10.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:10.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:11.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:11.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:11.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:11.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:12.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:12.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:12.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:12.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:13.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:13.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:13.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:13.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:14.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:14.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:14.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:14.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:15.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:15.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:15.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:15.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:16.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:16.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:16.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:16.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:17.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:17.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:17.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:17.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:18.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:18.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:18.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:18.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:19.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:19.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:19.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:19.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:20.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:20.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:20.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:20.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:21.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:21.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:21.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:21.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:22.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:22.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:22.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:22.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:23.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:23.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:23.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:23.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:24.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:24.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:24.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:24.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:25.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:25.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:25.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:25.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:26.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:26.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:26.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:26.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:27.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:27.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:27.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:27.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:28.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:28.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:28.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:28.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:29.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:29.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:29.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:29.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:30.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:30.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:30.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:30.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:31.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:31.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:31.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:31.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:32.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:32.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:32.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:32.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:33.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:33.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:33.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:33.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:34.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:34.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:34.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:34.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:35.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:35.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:35.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:35.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:36.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:36.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:36.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:36.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:37.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:37.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:37.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:37.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:38.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:38.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:38.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:38.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:39.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:39.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:39.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:39.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:40.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:40.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:40.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:40.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:41.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:41.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:41.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:41.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:42.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:42.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:42.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:42.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:43.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:43.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:43.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:43.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:44.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:44.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:44.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:44.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:45.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:45.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:45.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:45.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:46.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:46.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:46.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:46.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:47.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:47.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:47.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:47.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:48.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:48.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:48.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:48.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:49.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:49.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:49.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:49.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:50.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:50.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:50.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:50.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:51.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:51.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:51.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:51.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:52.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:52.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:52.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:52.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:53.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:53.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:53.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:53.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:54.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:54.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:54.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:54.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:55.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:55.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:55.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:55.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:56.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:56.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:56.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:56.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:57.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:57.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:57.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:57.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:58.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:58.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:58.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:58.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:59.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:00:59.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:00:59.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:00:59.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:00.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:00.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:00.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:00.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:01.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:01.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:01.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:01.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:02.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:02.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:02.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:02.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:03.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:03.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:03.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:03.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:04.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:04.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:04.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:04.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:05.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:05.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:05.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:05.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:06.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:06.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:06.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:06.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:07.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:07.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:07.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:07.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:08.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:08.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:08.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:08.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:09.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:09.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:09.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:09.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:10.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:10.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:10.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:10.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:11.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:11.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:11.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:11.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:12.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:12.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:12.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:12.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:13.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:13.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:13.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:13.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:14.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:14.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:14.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:14.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:15.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:15.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:15.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:15.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:16.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:16.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:16.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:16.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:17.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:17.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:17.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:17.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:18.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:18.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:18.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:18.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:19.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:19.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:19.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:19.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:20.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:20.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:20.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:20.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:21.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:21.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:21.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:21.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:22.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:22.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:22.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:22.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:23.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:23.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:23.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:23.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:24.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:24.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:24.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:24.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:25.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:25.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:25.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:25.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:26.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:26.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:26.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:26.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:27.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:27.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:27.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:27.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:28.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:28.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:28.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:28.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:29.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:29.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:29.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:29.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:30.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:30.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:30.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:30.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:31.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:31.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:31.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:31.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:32.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:32.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:32.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:32.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:33.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:33.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:33.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:33.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:34.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:34.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:34.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:34.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:35.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:35.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:35.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:35.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:36.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:36.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:36.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:36.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:37.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:37.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:37.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:37.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:38.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:38.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:38.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:38.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:39.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:39.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:39.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:39.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:40.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:40.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:40.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:40.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:41.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:41.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:41.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:41.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:42.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:42.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:42.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:42.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:43.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:43.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:43.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:43.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:44.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:44.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:44.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:44.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:45.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:45.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:45.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:45.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:46.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:46.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:46.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:46.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:47.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:47.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:47.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:47.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:48.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:48.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:48.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:48.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:49.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:49.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:49.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:49.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:50.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:50.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:50.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:50.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:51.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:51.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:51.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:51.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:52.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:52.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:52.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:52.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:53.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:53.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:53.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:53.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:54.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:54.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:54.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:54.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:55.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:55.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:55.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:55.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:56.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:56.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:56.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:56.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:57.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:57.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:57.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:57.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:58.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:58.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:58.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:58.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:59.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:01:59.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:01:59.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:01:59.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:00.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:00.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:00.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:00.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:01.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:01.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:01.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:01.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:02.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:02.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:02.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:02.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:03.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:03.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:03.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:03.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:04.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:04.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:04.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:04.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:05.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:05.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:05.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:05.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:06.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:06.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:06.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:06.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:07.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:07.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:07.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:07.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:08.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:08.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:08.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:08.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:09.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:09.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:09.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:09.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:10.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:10.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:10.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:10.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:11.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:11.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:11.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:11.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:12.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:12.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:12.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:12.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:13.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:13.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:13.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:13.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:14.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:14.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:14.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:14.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:15.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:15.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:15.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:15.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:16.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:16.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:16.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:16.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:17.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:17.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:17.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:17.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:18.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:18.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:18.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:18.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:19.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:19.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:19.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:19.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:20.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:20.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:20.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:20.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:21.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:21.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:21.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:21.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:22.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:22.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:22.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:22.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:23.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:23.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:23.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:23.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:24.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:24.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:24.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:24.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:25.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:25.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:25.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:25.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:26.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:26.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:26.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:26.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:27.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:27.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:27.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:27.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:28.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:28.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:28.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:28.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:29.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:29.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:29.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:29.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:30.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:30.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:30.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:30.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:31.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:31.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:31.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:31.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:32.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:32.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:32.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:32.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:33.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:33.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:33.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:33.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:34.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:34.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:34.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:34.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:35.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:35.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:35.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:35.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:36.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:36.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:36.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:36.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:37.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:37.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:37.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:37.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:38.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:38.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:38.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:38.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:39.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:39.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:39.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:39.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:40.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:40.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:40.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:40.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:41.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:41.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:41.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:41.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:42.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:42.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:42.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:42.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:43.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:43.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:43.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:43.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:44.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:44.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:44.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:44.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:45.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:45.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:45.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:45.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:46.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:46.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:46.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:46.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:47.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:47.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:47.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:47.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:48.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:48.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:48.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:48.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:49.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:49.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:49.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:49.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:50.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:50.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:50.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:50.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:51.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:51.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:51.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:51.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:52.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:52.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:52.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:52.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:53.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:53.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:53.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:53.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:54.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:54.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:54.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:54.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:55.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:55.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:55.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:55.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:56.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:56.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:56.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:56.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:57.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:57.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:57.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:57.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:58.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:58.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:58.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:58.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:59.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:02:59.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:02:59.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:02:59.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:00.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:00.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:00.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:00.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:01.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:01.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:01.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:01.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:02.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:02.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:02.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:02.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:03.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:03.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:03.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:03.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:04.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:04.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:04.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:04.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:05.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:05.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:05.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:05.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:06.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:06.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:06.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:06.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:07.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:07.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:07.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:07.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:08.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:08.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:08.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:08.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:09.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:09.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:09.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:09.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:10.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:10.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:10.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:10.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:11.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:11.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:11.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:11.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:12.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:12.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:12.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:12.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:13.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:13.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:13.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:13.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:14.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:14.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:14.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:14.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:15.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:15.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:15.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:15.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:16.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:16.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:16.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:16.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:17.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:17.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:17.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:17.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:18.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:18.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:18.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:18.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:19.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:19.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:19.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:19.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:20.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:20.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:20.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:20.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:21.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:21.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:21.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:21.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:22.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:22.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:22.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:22.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:23.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:23.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:23.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:23.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:24.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:24.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:24.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:24.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:25.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:25.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:25.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:25.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:26.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:26.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:26.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:26.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:27.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:27.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:27.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:27.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:28.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:28.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:28.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:28.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:29.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:29.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:29.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:29.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:30.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:30.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:30.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:30.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:31.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:31.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:31.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:31.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:32.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:32.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:32.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:32.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:33.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:33.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:33.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:33.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:34.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:34.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:34.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:34.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:35.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:35.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:35.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:35.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:36.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:36.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:36.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:36.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:37.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:37.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:37.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:37.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:38.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:38.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:38.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:38.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:39.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:39.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:39.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:39.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:40.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:40.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:40.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:40.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:41.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:41.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:41.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:41.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:42.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:42.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:42.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:42.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:43.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:43.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:43.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:43.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:44.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:44.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:44.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:44.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:45.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:45.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:45.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:45.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:46.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:46.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:46.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:46.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:47.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:47.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:47.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:47.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:48.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:48.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:48.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:48.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:49.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:49.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:49.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:49.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:50.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:50.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:50.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:50.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:51.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:51.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:51.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:51.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:52.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:52.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:52.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:52.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:53.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:53.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:53.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:53.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:54.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:54.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:54.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:54.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:55.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:55.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:55.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:55.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:56.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:56.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:56.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:56.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:57.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:57.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:57.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:57.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:58.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:58.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:58.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:58.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:59.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:03:59.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:03:59.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:03:59.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:00.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:00.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:00.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:00.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:01.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:01.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:01.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:01.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:02.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:02.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:02.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:02.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:03.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:03.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:03.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:03.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:04.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:04.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:04.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:04.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:05.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:05.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:05.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:05.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:06.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:06.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:06.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:06.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:07.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:07.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:07.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:07.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:08.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:08.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:08.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:08.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:09.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:09.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:09.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:09.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:10.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:10.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:10.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:10.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:11.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:11.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:11.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:11.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:12.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:12.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:12.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:12.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:13.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:13.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:13.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:13.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:14.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:14.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:14.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:14.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:15.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:15.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:15.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:15.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:16.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:16.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:16.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:16.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:17.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:17.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:17.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:17.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:18.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:18.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:18.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:18.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:19.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:19.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:19.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:19.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:20.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:20.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:20.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:20.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:21.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:21.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:21.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:21.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:22.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:22.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:22.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:22.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:23.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:23.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:23.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:23.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:24.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:24.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:24.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:24.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:25.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:25.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:25.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:25.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:26.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:26.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:26.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:26.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:27.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:27.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:27.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:27.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:28.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:28.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:28.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:28.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:29.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:29.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:29.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:29.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:30.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:30.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:30.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:30.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:31.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:31.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:31.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:31.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:32.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:32.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:32.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:32.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:33.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:33.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:33.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:33.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:34.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:34.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:34.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:34.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:35.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:35.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:35.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:35.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:36.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:36.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:36.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:36.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:37.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:37.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:37.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:37.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:38.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:38.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:38.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:38.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:39.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:39.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:39.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:39.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:40.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:40.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:40.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:40.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:41.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:41.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:41.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:41.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:42.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:42.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:42.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:42.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:43.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:43.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:43.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:43.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:44.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:44.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:44.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:44.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:45.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:45.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:45.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:45.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:46.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:46.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:46.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:46.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:47.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:47.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:47.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:47.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:48.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:48.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:48.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:48.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:49.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:49.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:49.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:49.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:50.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:50.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:50.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:50.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:51.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:51.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:51.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:51.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:52.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:52.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:52.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:52.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:53.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:53.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:53.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:53.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:54.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:54.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:54.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:54.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:55.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:55.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:55.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:55.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:56.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:56.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:56.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:56.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:57.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:57.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:57.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:57.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:58.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:58.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:58.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:58.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:59.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:04:59.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:04:59.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:04:59.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:00.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:00.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:00.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:00.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:01.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:01.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:01.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:01.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:02.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:02.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:02.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:02.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:03.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:03.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:03.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:03.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:04.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:04.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:04.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:04.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:05.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:05.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:05.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:05.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:06.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:06.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:06.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:06.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:07.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:07.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:07.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:07.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:08.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:08.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:08.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:08.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:09.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:09.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:09.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:09.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:10.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:10.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:10.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:10.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:11.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:11.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:11.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:11.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:12.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:12.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:12.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:12.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:13.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:13.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:13.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:13.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:14.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:14.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:14.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:14.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:15.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:15.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:15.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:15.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:16.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:16.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:16.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:16.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:17.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:17.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:17.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:17.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:18.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:18.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:18.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:18.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:19.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:19.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:19.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:19.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:20.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:20.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:20.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:20.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:21.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:21.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:21.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:21.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:22.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:22.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:22.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:22.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:23.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:23.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:23.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:23.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:24.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:24.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:24.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:24.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:25.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:25.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:25.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:25.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:26.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:26.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:26.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:26.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:27.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:27.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:27.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:27.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:28.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:28.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:28.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:28.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:29.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:29.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:29.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:29.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:30.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:30.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:30.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:30.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:31.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:31.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:31.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:31.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:32.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:32.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:32.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:32.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:33.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:33.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:33.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:33.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:34.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:34.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:34.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:34.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:35.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:35.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:35.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:35.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:36.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:36.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:36.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:36.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:37.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:37.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:37.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:37.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:38.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:38.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:38.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:38.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:39.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:39.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:39.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:39.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:40.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:40.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:40.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:40.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:41.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:41.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:41.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:41.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:42.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:42.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:42.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:42.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:43.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:43.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:43.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:43.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:44.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:44.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:44.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:44.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:45.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:45.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:45.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:45.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:46.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:46.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:46.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:46.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:47.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:47.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:47.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:47.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:48.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:48.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:48.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:48.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:49.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:49.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:49.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:49.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:50.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:50.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:50.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:50.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:51.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:51.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:51.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:51.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:52.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:52.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:52.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:52.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:53.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:53.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:53.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:53.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:54.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:54.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:54.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:54.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:55.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:55.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:55.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:55.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:56.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:56.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:56.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:56.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:57.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:57.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:57.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:57.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:58.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:58.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:58.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:58.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:59.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:05:59.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:05:59.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:05:59.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:00.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:00.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:00.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:00.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:01.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:01.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:01.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:01.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:02.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:02.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:02.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:02.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:03.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:03.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:03.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:03.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:04.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:04.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:04.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:04.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:05.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:05.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:05.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:05.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:06.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:06.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:06.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:06.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:07.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:07.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:07.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:07.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:08.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:08.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:08.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:08.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:09.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:09.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:09.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:09.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:10.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:10.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:10.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:10.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:11.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:11.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:11.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:11.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:12.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:12.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:12.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:12.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:13.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:13.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:13.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:13.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:14.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:14.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:14.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:14.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:15.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:15.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:15.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:15.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:16.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:16.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:16.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:16.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:17.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:17.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:17.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:17.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:18.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:18.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:18.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:18.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:19.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:19.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:19.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:19.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:20.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:20.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:20.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:20.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:21.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:21.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:21.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:21.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:22.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:22.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:22.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:22.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:23.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:23.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:23.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:23.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:24.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:24.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:24.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:24.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:25.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:25.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:25.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:25.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:26.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:26.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:26.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:26.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:27.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:27.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:27.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:27.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:28.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:28.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:28.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:28.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:29.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:29.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:29.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:29.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:30.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:30.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:30.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:30.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:31.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:31.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:31.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:31.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:32.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:32.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:32.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:32.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:33.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:33.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:33.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:33.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:34.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:34.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:34.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:34.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:35.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:35.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:35.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:35.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:36.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:36.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:36.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:36.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:37.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:37.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:37.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:37.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:38.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:38.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:38.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:38.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:39.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:39.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:39.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:39.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:40.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:40.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:40.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:40.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:41.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:41.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:41.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:41.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:42.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:42.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:42.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:42.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:43.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:43.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:43.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:43.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:44.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:44.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:44.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:44.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:45.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:45.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:45.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:45.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:46.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:46.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:46.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:46.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:47.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:47.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:47.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:47.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:48.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:48.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:48.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:48.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:49.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:49.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:49.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:49.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:50.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:50.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:50.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:50.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:51.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:51.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:51.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:51.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:52.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:52.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:52.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:52.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:53.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:53.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:53.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:53.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:54.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:54.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:54.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:54.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:55.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:55.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:55.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:55.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:56.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:56.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:56.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:56.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:57.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:57.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:57.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:57.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:58.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:58.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:58.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:58.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:59.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:06:59.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:06:59.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:06:59.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:00.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:00.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:00.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:00.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:01.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:01.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:01.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:01.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:02.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:02.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:02.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:02.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:03.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:03.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:03.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:03.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:04.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:04.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:04.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:04.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:05.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:05.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:05.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:05.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:06.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:06.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:06.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:06.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:07.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:07.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:07.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:07.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:08.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:08.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:08.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:08.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:09.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:09.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:09.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:09.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:10.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:10.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:10.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:10.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:11.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:11.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:11.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:11.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:12.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:12.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:12.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:12.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:13.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:13.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:13.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:13.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:14.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:14.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:14.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:14.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:15.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:15.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:15.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:15.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:16.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:16.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:16.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:16.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:17.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:17.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:17.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:17.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:18.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:18.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:18.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:18.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:19.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:19.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:19.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:19.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:20.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:20.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:20.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:20.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:21.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:21.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:21.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:21.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:22.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:22.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:22.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:22.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:23.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:23.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:23.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:23.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:24.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:24.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:24.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:24.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:25.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:25.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:25.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:25.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:26.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:26.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:26.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:26.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:27.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:27.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:27.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:27.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:28.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:28.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:28.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:28.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:29.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:29.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:29.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:29.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:30.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:30.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:30.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:30.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:31.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:31.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:31.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:31.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:32.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:32.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:32.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:32.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:33.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:33.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:33.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:33.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:34.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:34.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:34.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:34.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:35.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:35.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:35.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:35.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:36.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:36.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:36.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:36.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:37.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:37.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:37.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:37.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:38.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:38.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:38.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:38.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:39.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:39.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:39.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:39.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:40.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:40.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:40.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:40.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:41.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:41.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:41.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:41.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:42.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:42.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:42.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:42.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:43.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:43.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:43.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:43.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:44.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:44.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:44.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:44.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:45.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:45.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:45.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:45.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:46.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:46.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:46.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:46.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:47.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:47.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:47.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:47.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:48.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:48.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:48.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:48.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:49.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:49.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:49.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:49.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:50.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:50.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:50.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:50.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:51.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:51.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:51.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:51.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:52.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:52.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:52.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:52.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:53.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:53.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:53.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:53.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:54.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:54.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:54.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:54.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:55.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:55.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:55.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:55.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:56.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:56.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:56.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:56.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:57.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:57.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:57.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:57.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:58.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:58.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:58.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:58.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:59.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:07:59.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:07:59.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:07:59.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:00.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:00.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:00.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:00.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:01.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:01.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:01.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:01.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:02.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:02.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:02.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:02.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:03.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:03.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:03.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:03.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:04.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:04.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:04.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:04.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:05.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:05.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:05.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:05.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:06.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:06.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:06.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:06.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:07.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:07.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:07.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:07.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:08.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:08.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:08.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:08.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:09.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:09.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:09.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:09.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:10.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:10.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:10.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:10.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:11.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:11.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:11.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:11.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:12.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:12.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:12.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:12.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:13.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:13.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:13.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:13.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:14.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:14.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:14.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:14.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:15.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:15.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:15.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:15.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:16.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:16.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:16.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:16.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:17.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:17.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:17.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:17.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:18.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:18.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:18.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:18.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:19.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:19.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:19.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:19.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:20.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:20.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:20.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:20.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:21.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:21.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:21.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:21.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:22.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:22.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:22.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:22.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:23.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:23.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:23.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:23.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:24.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:24.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:24.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:24.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:25.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:25.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:25.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:25.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:26.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:26.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:26.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:26.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:27.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:27.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:27.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:27.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:28.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:28.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:28.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:28.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:29.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:29.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:29.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:29.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:30.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:30.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:30.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:30.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:31.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:31.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:31.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:31.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:32.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:32.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:32.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:32.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:33.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:33.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:33.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:33.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:34.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:34.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:34.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:34.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:35.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:35.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:35.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:35.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:36.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:36.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:36.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:36.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:37.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:37.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:37.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:37.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:38.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:38.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:38.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:38.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:39.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:39.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:39.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:39.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:40.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:40.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:40.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:40.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:41.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:41.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:41.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:41.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:42.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:42.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:42.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:42.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:43.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:43.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:43.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:43.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:44.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:44.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:44.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:44.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:45.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:45.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:45.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:45.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:46.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:46.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:46.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:46.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:47.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:47.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:47.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:47.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:48.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:48.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:48.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:48.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:49.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:49.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:49.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:49.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:50.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:50.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:50.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:50.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:51.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:51.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:51.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:51.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:52.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:52.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:52.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:52.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:53.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:53.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:53.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:53.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:54.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:54.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:54.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:54.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:55.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:55.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:55.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:55.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:56.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:56.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:56.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:56.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:57.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:57.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:57.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:57.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:58.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:58.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:58.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:58.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:59.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:08:59.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:08:59.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:08:59.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:00.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:00.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:00.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:00.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:01.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:01.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:01.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:01.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:02.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:02.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:02.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:02.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:03.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:03.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:03.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:03.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:04.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:04.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:04.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:04.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:05.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:05.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:06.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:06.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:06.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:06.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:07.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:07.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:07.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:07.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:08.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:08.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:08.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:08.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:08.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:08.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:09.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:09.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:10.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:10.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:10.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:10.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:11.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:11.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:11.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:11.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:12.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:12.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:12.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:12.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:13.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:13.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:13.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:13.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:14.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:14.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:14.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:14.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:15.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:15.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:15.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:15.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:16.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:16.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:16.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:16.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:17.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:17.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:17.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:17.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:18.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:18.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:18.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:18.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:19.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:19.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:19.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:19.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:20.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:20.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:20.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:20.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:21.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:21.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:21.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:21.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:22.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:22.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:22.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:22.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:23.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:23.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:23.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:23.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:24.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:24.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:24.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:24.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:25.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:25.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:25.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:25.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:26.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:26.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:26.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:26.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:27.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:27.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:27.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:27.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:28.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:28.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:28.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:28.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:29.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:29.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:29.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:29.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:30.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:30.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:30.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:30.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:31.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:31.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:31.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:31.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:32.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:32.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:32.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:32.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:33.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:33.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:33.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:33.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:34.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:34.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:34.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:34.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:35.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:35.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:35.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:35.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:36.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:36.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:36.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:36.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:37.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:37.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:37.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:37.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:38.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:38.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:38.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:38.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:39.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:39.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:39.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:39.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:40.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:40.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:40.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:40.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:41.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:41.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:41.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:41.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:42.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:42.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:42.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:42.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:43.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:43.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:43.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:43.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:44.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:44.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:44.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:44.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:45.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:45.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:45.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:45.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:46.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:46.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:46.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:46.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:47.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:47.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:47.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:47.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:48.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:48.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:48.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:48.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:49.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:49.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:49.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:49.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:50.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:50.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:50.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:50.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:50.991 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T21:09:50.986+0000 7f5fc4669700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6808/29215,v1:172.21.15.163:6809/29215] conn(0x7f5fa8008740 msgr2=0x7f5fa4038cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T21:09:51.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:51.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:51.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:51.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:52.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:52.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:52.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:52.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:53.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:53.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:53.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:53.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:54.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:54.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:55.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:54.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:55.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:55.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:56.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:56.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:56.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:56.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:57.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:57.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:57.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:57.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:58.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:58.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:58.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:58.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:58.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:09:58.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:09:59.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:09:59.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:00.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:00.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:00.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:00.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:00.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:00.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:01.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:01.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:02.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:02.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:02.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:02.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:03.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:03.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:03.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:03.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:04.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:04.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:04.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:04.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:05.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:05.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:05.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:05.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:06.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:06.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:06.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:06.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:07.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:07.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:07.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:07.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:08.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:08.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:08.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:08.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:09.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:09.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:09.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:09.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:10.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:10.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:10.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:10.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:10.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:10.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:11.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:11.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:11.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:11.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:12.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:12.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:12.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:12.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:13.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:13.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:13.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:13.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:14.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:14.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:14.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:14.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:15.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:15.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:16.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:16.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:16.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:16.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:16.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:16.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:17.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:17.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:17.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:17.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:18.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:18.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:18.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:18.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:19.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:19.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:19.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:19.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:20.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:20.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:20.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:20.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:21.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:21.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:21.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:21.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:22.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:22.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:22.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:22.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:23.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:23.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:23.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:23.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:24.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:24.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:24.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:24.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:25.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:25.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:25.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:25.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:26.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:26.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:26.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:26.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:27.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:27.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:27.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:27.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:28.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:28.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:28.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:28.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:29.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:29.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:29.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:29.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:30.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:30.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:31.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:31.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:31.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:31.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:32.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:32.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:32.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:32.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:33.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:33.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:33.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:33.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:34.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:34.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:34.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:34.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:35.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:35.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:35.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:35.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:36.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:36.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:36.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:36.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:37.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:37.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:37.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:37.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:37.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:37.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:38.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:38.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:39.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:39.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:39.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:39.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:40.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:40.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:40.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:40.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:41.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:41.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:41.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:41.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:42.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:42.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:42.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:42.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:43.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:43.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:43.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:43.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:44.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:44.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:44.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:44.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:45.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:45.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:45.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:45.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:46.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:46.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:46.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:46.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:47.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:47.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:47.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:47.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:48.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:48.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:48.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:48.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:49.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:49.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:49.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:49.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:50.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:50.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:50.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:50.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:51.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:51.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:51.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:51.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:52.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:52.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:52.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:52.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:53.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:53.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:53.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:53.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:54.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:54.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:54.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:54.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:55.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:55.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:55.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:55.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:56.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:56.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:56.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:56.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:57.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:57.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:57.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:57.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:58.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:58.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:58.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:58.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:59.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:10:59.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:10:59.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:10:59.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:00.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:00.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:00.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:00.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:01.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:01.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:01.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:01.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:02.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:02.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:02.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:02.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:03.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:03.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:03.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:03.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:04.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:04.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:04.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:04.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:05.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:05.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:05.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:05.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:06.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:06.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:06.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:06.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:07.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:07.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:07.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:07.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:08.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:08.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:08.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:08.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:09.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:09.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:09.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:09.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:10.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:10.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:10.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:10.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:11.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:11.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:11.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:11.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:12.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:12.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:12.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:12.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:13.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:13.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:13.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:13.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:14.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:14.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:14.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:14.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:15.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:15.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:15.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:15.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:16.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:16.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:16.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:16.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:17.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:17.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:17.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:17.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:18.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:18.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:18.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:18.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:19.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:19.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:19.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:19.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:20.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:20.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:20.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:20.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:21.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:21.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:21.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:21.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:22.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:22.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:22.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:22.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:23.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:23.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:23.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:23.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:24.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:24.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:24.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:24.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:25.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:25.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:25.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:25.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:26.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:26.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:26.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:26.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:27.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:27.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:27.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:27.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:28.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:28.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:28.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:28.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:29.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:29.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:29.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:29.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:30.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:30.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:30.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:30.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:31.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:31.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:31.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:31.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:32.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:32.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:32.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:32.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:33.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:33.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:33.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:33.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:34.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:34.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:34.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:34.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:35.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:35.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:35.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:35.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:36.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:36.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:36.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:36.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:37.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:37.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:37.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:37.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:38.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:38.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:38.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:38.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:39.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:39.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:39.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:39.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:40.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:40.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:40.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:40.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:41.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:41.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:41.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:41.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:42.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:42.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:42.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:42.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:43.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:43.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:43.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:43.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:44.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:44.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:44.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:44.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:45.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:45.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:45.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:45.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:46.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:46.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:46.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:46.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:47.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:47.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:47.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:47.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:48.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:48.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:48.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:48.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:49.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:49.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:49.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:49.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:50.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:50.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:50.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:50.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:51.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:51.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:51.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:51.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:52.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:52.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:52.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:52.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:53.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:53.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:53.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:53.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:54.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:54.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:54.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:54.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:55.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:55.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:55.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:55.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:56.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:56.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:56.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:56.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:57.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:57.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:57.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:57.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:58.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:58.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:58.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:58.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:59.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:11:59.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:11:59.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:11:59.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:00.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:00.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:00.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:00.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:01.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:01.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:01.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:01.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:02.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:02.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:02.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:02.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:03.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:03.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:03.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:03.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:04.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:04.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:04.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:04.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:05.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:05.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:05.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:05.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:06.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:06.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:06.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:06.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:07.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:07.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:07.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:07.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:08.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:08.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:08.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:08.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:09.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:09.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:09.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:09.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:10.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:10.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:10.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:10.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:11.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:11.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:11.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:11.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:12.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:12.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:12.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:12.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:13.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:13.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:13.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:13.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:14.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:14.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:14.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:14.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:15.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:15.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:15.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:15.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:16.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:16.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:16.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:16.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:17.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:17.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:17.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:17.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:18.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:18.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:18.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:18.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:19.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:19.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:19.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:19.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:20.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:20.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:20.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:20.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:21.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:21.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:21.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:21.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:22.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:22.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:22.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:22.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:23.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:23.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:23.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:23.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:24.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:24.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:24.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:24.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:25.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:25.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:25.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:25.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:26.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:26.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:26.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:26.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:27.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:27.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:27.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:27.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:28.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:28.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:28.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:28.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:29.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:29.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:29.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:29.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:30.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:30.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:30.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:30.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:31.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:31.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:31.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:31.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:32.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:32.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:32.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:32.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:33.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:33.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:33.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:33.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:34.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:34.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:34.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:34.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:35.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:35.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:35.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:35.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:36.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:36.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:36.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:36.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:37.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:37.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:37.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:37.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:38.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:38.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:38.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:38.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:39.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:39.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:39.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:39.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:40.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:40.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:40.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:40.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:41.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:41.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:41.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:41.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:42.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:42.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:42.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:42.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:43.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:43.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:43.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:43.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:44.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:44.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:44.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:44.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:45.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:45.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:45.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:45.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:46.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:46.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:46.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:46.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:47.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:47.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:47.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:47.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:48.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:48.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:48.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:48.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:48.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:48.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:49.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:49.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:50.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:50.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:50.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:50.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:51.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:51.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:51.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:51.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:52.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:52.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:52.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:52.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:53.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:53.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:53.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:53.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:54.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:54.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:54.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:54.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:55.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:55.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:55.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:55.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:56.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:56.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:56.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:56.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:57.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:57.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:57.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:57.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:58.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:58.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:58.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:58.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:59.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:12:59.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:12:59.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:12:59.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:00.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:00.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:00.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:00.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:01.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:01.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:01.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:01.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:02.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:02.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:02.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:02.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:03.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:03.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:03.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:03.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:04.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:04.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:04.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:04.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:05.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:05.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:05.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:05.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:06.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:06.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:06.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:06.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:07.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:07.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:07.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:07.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:08.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:08.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:08.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:08.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:09.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:09.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:09.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:09.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:10.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:10.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:10.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:10.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:11.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:11.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:12.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:12.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:12.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:12.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:13.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:13.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:13.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:13.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:14.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:14.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:14.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:14.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:15.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:15.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:15.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:15.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:16.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:16.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:16.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:16.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:17.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:17.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:17.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:17.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:18.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:18.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:18.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:18.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:19.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:19.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:19.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:19.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:20.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:20.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:20.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:20.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:21.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:21.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:21.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:21.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:22.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:22.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:22.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:22.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:23.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:23.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:23.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:23.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:24.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:24.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:24.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:24.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:25.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:25.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:25.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:25.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:26.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:26.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:26.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:26.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:26.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:26.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:27.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:27.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:28.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:28.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:28.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:28.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:29.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:29.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:29.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:29.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:30.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:30.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:30.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:30.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:30.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:30.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:31.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:31.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:31.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:31.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:32.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:32.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:32.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:33.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:33.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:34.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:34.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:34.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:34.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:35.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:35.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:35.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:35.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:36.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:36.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:36.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:36.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:37.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:37.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:37.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:37.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:38.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:37.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:38.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:38.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:39.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:39.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:39.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:39.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:39.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:39.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:40.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:40.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:40.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:40.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:41.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:41.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:41.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:41.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:42.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:42.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:42.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:42.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:43.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:43.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:43.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:43.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:44.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:44.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:44.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:44.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:45.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:45.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:45.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:45.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:46.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:46.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:47.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:47.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:47.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:47.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:48.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:48.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:48.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:48.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:49.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:49.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:49.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:49.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:50.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:50.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:50.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:50.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:51.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:51.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:51.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:51.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:52.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:52.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:52.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:52.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:53.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:53.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:53.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:53.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:54.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:54.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:54.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:54.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:55.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:55.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:55.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:55.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:56.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:56.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:56.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:56.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:57.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:57.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:57.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:57.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:58.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:58.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:58.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:58.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:59.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:59.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:59.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:13:59.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:13:59.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:13:59.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:00.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:00.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:00.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:00.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:01.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:01.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:01.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:01.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:02.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:02.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:02.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:02.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:03.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:03.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:04.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:04.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:04.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:04.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:05.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:05.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:05.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:05.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:06.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:06.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:06.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:06.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:07.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:07.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:07.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:07.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:08.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:07.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:08.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:08.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:08.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:08.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:09.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:09.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:09.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:09.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:10.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:10.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:10.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:10.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:11.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:11.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:11.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:11.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:12.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:12.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:12.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:12.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:13.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:13.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:13.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:13.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:14.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:14.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:14.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:14.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:15.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:15.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:15.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:15.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:16.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:16.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:17.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:17.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:17.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:17.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:18.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:17.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:18.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:18.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:19.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:19.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:19.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:19.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:20.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:20.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:20.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:20.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:21.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:21.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:21.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:21.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:22.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:22.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:22.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:22.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:23.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:23.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:23.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:23.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:24.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:24.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:24.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:24.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:25.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:25.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:25.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:25.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:26.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:26.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:26.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:27.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:27.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:27.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:27.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:28.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:28.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:28.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:28.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:29.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:29.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:29.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:30.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:30.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:30.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:30.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:31.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:31.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:31.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:31.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:32.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:32.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:32.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:32.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:33.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:33.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:33.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:33.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:34.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:34.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:34.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:34.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:35.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:35.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:35.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:35.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:36.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:36.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:36.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:36.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:37.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:37.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:37.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:37.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:38.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:38.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:38.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:38.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:39.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:39.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:39.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:39.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:40.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:40.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:40.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:40.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:41.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:41.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:41.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:41.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:42.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:42.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:42.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:42.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:43.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:43.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:43.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:43.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:44.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:44.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:44.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:44.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:45.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:45.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:45.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:45.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:46.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:46.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:46.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:46.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:47.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:47.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:47.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:47.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:48.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:48.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:48.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:48.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:49.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:49.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:49.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:49.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:50.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:50.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:50.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:50.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:51.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:51.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:51.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:51.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:52.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:52.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:52.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:52.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:53.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:53.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:53.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:53.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:54.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:54.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:54.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:54.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:55.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:55.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:55.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:55.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:56.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:56.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:56.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:56.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:57.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:57.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:57.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:57.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:58.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:58.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:58.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:58.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:59.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:14:59.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:14:59.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:14:59.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:00.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:00.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:00.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:00.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:01.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:01.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:01.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:01.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:02.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:02.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:02.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:02.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:03.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:03.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:03.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:03.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:04.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:04.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:04.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:04.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:05.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:05.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:05.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:05.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:06.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:06.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:06.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:06.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:07.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:07.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:07.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:07.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:08.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:08.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:08.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:08.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:09.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:09.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:09.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:09.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:10.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:10.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:10.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:10.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:11.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:11.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:11.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:11.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:12.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:12.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:12.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:12.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:13.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:13.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:13.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:13.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:14.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:14.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:14.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:14.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:15.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:15.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:15.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:15.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:16.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:16.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:16.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:16.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:17.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:17.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:17.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:17.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:18.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:18.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:18.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:18.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:19.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:19.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:19.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:19.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:20.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:20.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:20.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:20.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:21.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:21.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:21.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:21.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:22.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:22.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:22.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:22.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:23.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:23.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:23.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:23.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:24.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:24.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:24.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:24.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:25.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:25.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:25.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:25.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:26.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:26.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:26.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:26.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:27.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:27.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:27.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:27.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:28.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:28.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:28.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:28.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:29.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:29.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:29.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:29.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:30.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:30.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:30.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:30.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:31.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:31.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:31.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:31.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:32.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:32.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:32.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:32.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:33.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:33.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:33.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:33.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:34.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:34.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:34.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:34.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:35.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:35.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:35.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:35.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:36.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:36.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:36.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:36.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:37.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:37.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:37.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:37.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:38.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:38.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:38.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:38.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:39.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:39.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:39.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:39.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:40.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:40.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:40.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:40.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:41.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:41.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:41.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:41.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:42.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:42.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:42.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:42.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:43.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:43.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:43.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:43.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:44.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:44.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:44.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:44.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:45.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:45.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:45.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:45.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:46.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:46.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:46.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:46.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:47.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:47.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:47.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:47.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:48.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:48.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:48.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:48.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:49.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:49.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:49.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:49.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:50.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:50.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:50.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:50.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:51.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:51.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:51.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:51.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:52.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:52.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:52.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:52.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:53.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:53.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:53.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:53.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:54.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:54.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:54.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:54.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:55.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:55.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:55.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:55.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:56.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:56.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:56.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:56.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:57.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:57.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:57.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:57.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:58.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:58.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:58.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:58.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:59.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:15:59.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:15:59.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:15:59.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:00.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:00.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:00.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:00.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:01.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:01.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:01.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:01.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:02.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:02.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:02.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:02.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:03.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:03.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:03.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:03.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:04.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:04.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:04.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:04.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:05.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:05.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:05.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:05.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:06.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:06.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:06.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:06.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:07.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:07.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:07.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:07.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:08.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:08.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:08.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:08.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:09.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:09.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:09.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:09.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:10.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:10.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:10.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:10.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:11.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:11.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:11.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:11.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:12.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:12.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:12.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:12.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:13.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:13.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:13.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:13.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:14.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:14.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:14.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:14.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:15.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:15.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:15.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:15.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:16.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:16.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:16.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:16.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:17.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:17.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:17.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:17.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:18.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:18.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:18.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:18.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:19.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:19.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:19.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:19.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:20.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:20.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:20.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:20.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:21.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:21.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:21.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:21.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:22.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:22.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:22.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:22.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:23.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:23.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:23.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:23.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:24.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:24.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:24.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:24.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:25.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:25.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:25.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:25.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:26.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:26.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:26.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:26.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:27.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:27.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:27.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:27.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:28.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:28.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:28.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:28.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:29.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:29.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:29.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:29.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:30.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:30.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:30.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:30.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:31.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:31.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:31.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:31.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:32.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:32.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:32.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:32.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:33.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:33.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:33.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:33.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:34.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:34.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:34.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:34.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:35.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:35.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:35.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:36.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:36.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:36.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:36.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:37.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:37.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:37.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:37.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:38.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:38.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:38.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:38.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:39.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:39.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:39.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:39.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:40.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:40.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:40.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:40.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:41.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:41.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:41.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:41.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:42.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:42.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:42.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:42.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:43.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:43.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:43.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:43.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:44.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:44.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:44.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:44.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:45.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:45.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:45.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:45.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:46.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:46.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:46.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:46.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:47.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:47.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:47.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:47.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:48.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:48.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:48.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:48.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:49.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:49.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:49.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:49.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:50.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:50.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:50.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:50.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:51.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:51.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:51.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:51.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:52.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:52.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:52.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:52.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:53.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:53.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:53.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:53.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:54.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:54.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:54.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:54.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:55.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:55.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:55.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:55.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:56.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:56.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:56.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:56.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:57.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:57.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:57.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:57.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:58.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:58.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:58.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:58.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:59.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:16:59.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:16:59.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:16:59.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:00.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:00.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:00.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:00.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:01.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:01.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:01.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:01.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:02.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:02.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:02.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:02.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:03.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:03.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:03.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:03.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:04.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:04.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:04.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:04.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:05.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:05.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:05.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:05.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:06.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:06.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:06.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:06.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:07.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:07.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:07.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:07.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:08.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:08.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:08.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:08.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:09.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:09.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:09.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:09.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:10.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:10.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:10.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:10.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:11.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:11.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:11.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:11.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:12.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:12.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:12.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:12.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:13.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:13.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:13.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:13.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:14.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:14.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:14.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:14.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:15.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:15.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:15.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:15.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:16.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:16.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:16.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:16.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:17.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:17.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:17.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:17.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:18.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:18.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:18.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:18.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:19.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:19.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:19.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:19.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:20.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:20.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:20.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:20.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:21.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:21.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:21.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:21.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:22.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:22.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:22.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:22.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:23.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:23.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:23.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:23.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:24.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:24.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:24.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:24.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:25.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:25.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:25.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:25.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:26.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:26.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:26.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:26.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:27.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:27.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:27.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:27.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:28.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:28.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:28.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:28.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:29.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:29.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:29.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:29.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:30.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:30.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:30.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:30.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:31.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:31.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:31.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:31.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:32.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:32.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:32.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:32.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:33.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:33.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:33.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:33.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:34.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:34.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:34.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:34.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:35.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:35.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:35.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:35.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:36.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:36.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:36.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:36.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:37.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:37.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:37.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:37.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:38.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:38.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:38.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:38.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:39.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:39.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:39.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:39.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:40.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:40.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:40.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:40.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:41.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:41.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:41.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:41.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:42.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:42.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:42.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:42.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:43.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:43.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:43.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:43.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:44.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:44.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:44.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:44.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:45.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:45.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:45.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:45.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:46.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:46.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:46.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:46.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:47.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:47.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:47.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:47.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:48.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:48.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:48.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:48.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:49.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:49.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:49.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:49.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:50.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:50.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:50.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:50.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:51.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:51.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:51.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:51.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:52.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:52.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:52.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:52.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:53.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:53.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:53.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:53.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:54.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:54.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:54.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:54.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:55.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:55.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:55.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:55.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:56.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:56.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:56.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:56.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:57.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:57.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:57.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:57.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:58.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:58.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:58.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:58.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:59.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:17:59.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:17:59.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:17:59.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:00.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:00.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:00.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:00.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:01.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:01.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:01.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:01.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:02.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:02.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:03.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:02.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:03.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:03.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:04.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:04.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:04.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:04.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:05.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:05.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:05.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:05.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:06.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:06.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:06.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:06.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:07.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:07.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:07.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:07.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:08.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:08.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:08.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:08.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:09.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:09.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:09.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:09.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:10.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:10.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:10.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:10.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:11.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:11.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:11.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:11.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:12.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:12.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:12.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:12.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:13.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:13.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:13.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:13.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:14.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:14.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:14.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:14.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:15.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:15.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:15.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:15.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:16.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:16.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:16.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:16.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:17.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:17.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:17.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:17.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:18.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:18.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:18.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:18.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:19.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:19.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:19.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:19.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:20.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:20.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:20.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:20.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:21.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:21.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:21.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:21.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:22.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:22.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:22.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:22.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:23.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:23.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:23.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:23.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:24.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:24.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:24.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:24.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:25.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:25.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:25.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:25.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:26.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:26.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:26.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:26.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:27.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:27.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:27.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:27.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:28.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:28.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:28.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:28.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:29.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:29.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:29.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:29.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:30.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:30.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:30.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:30.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:31.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:31.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:31.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:31.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:32.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:32.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:32.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:32.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:33.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:33.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:33.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:33.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:34.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:34.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:34.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:34.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:35.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:35.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:35.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:35.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:36.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:36.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:36.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:36.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:37.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:37.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:37.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:37.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:38.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:38.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:38.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:38.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:39.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:39.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:39.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:39.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:40.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:40.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:40.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:40.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:41.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:41.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:41.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:41.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:42.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:42.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:42.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:42.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:43.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:43.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:43.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:43.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:44.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:44.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:44.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:44.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:45.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:45.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:45.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:45.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:46.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:46.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:46.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:46.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:47.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:47.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:47.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:47.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:48.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:48.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:48.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:48.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:49.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:49.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:49.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:49.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:50.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:50.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:50.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:50.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:51.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:51.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:51.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:51.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:52.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:52.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:52.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:52.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:53.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:53.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:53.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:53.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:54.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:54.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:54.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:54.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:55.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:55.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:55.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:55.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:56.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:56.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:56.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:56.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:57.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:57.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:57.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:57.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:58.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:58.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:58.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:58.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:59.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:18:59.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:18:59.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:18:59.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:00.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:00.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:00.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:00.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:01.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:01.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:01.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:01.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:02.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:02.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:02.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:02.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:03.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:03.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:03.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:03.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:04.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:04.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:04.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:04.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:05.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:05.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:05.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:05.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:06.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:06.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:06.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:06.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:07.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:07.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:07.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:07.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:08.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:08.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:08.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:08.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:09.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:09.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:09.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:09.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:10.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:10.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:10.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:10.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:11.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:11.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:11.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:11.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:12.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:12.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:12.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:12.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:13.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:13.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:13.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:13.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:14.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:14.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:14.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:14.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:15.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:15.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:15.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:15.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:16.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:16.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:16.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:16.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:17.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:17.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:17.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:17.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:18.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:18.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:18.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:18.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:19.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:19.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:19.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:19.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:20.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:20.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:20.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:20.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:21.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:21.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:21.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:21.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:22.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:22.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:22.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:22.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:23.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:23.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:23.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:23.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:24.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:24.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:24.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:24.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:25.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:25.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:25.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:25.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:26.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:26.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:26.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:26.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:27.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:27.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:27.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:27.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:28.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:28.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:28.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:28.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:29.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:29.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:29.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:29.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:30.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:30.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:30.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:30.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:31.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:31.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:31.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:31.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:32.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:32.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:32.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:32.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:33.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:33.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:33.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:33.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:34.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:34.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:34.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:34.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:35.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:35.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:35.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:35.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:36.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:36.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:36.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:36.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:37.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:37.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:37.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:37.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:38.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:38.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:38.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:38.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:39.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:39.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:39.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:39.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:40.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:40.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:40.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:40.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:41.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:41.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:41.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:41.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:42.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:42.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:42.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:42.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:43.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:43.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:43.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:43.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:44.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:44.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:44.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:44.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:45.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:45.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:45.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:45.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:46.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:46.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:46.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:46.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:47.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:47.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:47.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:47.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:48.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:48.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:48.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:48.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:49.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:49.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:49.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:49.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:50.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:50.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:50.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:50.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:51.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:51.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:51.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:51.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:52.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:52.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:52.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:52.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:53.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:53.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:53.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:53.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:54.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:54.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:54.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:54.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:55.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:55.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:55.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:55.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:56.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:56.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:56.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:56.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:57.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:57.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:57.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:57.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:58.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:58.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:58.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:58.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:59.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:19:59.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:19:59.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:19:59.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:00.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:00.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:00.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:00.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:01.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:01.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:01.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:01.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:02.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:02.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:02.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:02.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:03.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:03.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:03.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:03.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:04.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:04.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:04.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:04.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:05.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:05.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:05.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:05.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:06.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:06.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:06.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:06.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:07.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:07.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:07.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:07.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:08.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:08.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:08.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:08.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:09.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:09.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:09.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:09.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:10.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:10.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:10.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:10.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:11.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:11.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:11.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:11.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:12.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:12.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:12.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:12.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:13.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:13.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:13.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:13.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:14.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:14.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:14.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:14.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:15.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:15.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:15.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:15.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:16.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:16.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:16.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:16.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:17.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:17.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:17.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:17.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:18.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:18.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:18.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:18.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:19.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:19.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:19.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:19.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:20.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:20.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:20.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:20.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:21.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:21.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:21.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:21.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:22.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:22.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:22.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:22.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:23.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:23.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:23.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:23.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:24.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:24.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:24.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:24.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:25.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:25.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:25.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:25.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:26.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:26.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:26.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:26.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:27.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:27.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:27.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:27.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:28.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:28.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:28.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:28.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:29.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:29.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:29.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:29.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:30.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:30.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:30.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:30.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:31.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:31.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:31.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:31.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:32.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:32.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:32.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:32.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:33.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:33.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:33.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:33.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:34.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:34.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:34.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:34.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:35.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:35.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:35.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:35.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:36.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:36.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:36.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:36.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:37.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:37.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:37.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:37.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:38.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:38.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:38.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:38.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:39.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:39.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:39.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:39.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:40.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:40.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:40.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:40.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:41.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:41.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:41.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:41.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:42.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:42.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:42.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:42.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:43.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:43.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:43.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:43.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:44.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:44.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:44.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:44.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:45.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:45.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:45.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:45.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:46.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:46.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:46.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:46.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:47.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:47.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:47.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:47.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:48.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:48.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:48.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:48.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:49.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:49.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:49.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:49.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:50.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:50.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:50.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:50.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:51.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:51.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:51.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:51.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:52.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:52.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:52.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:52.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:53.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:53.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:53.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:53.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:54.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:54.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:54.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:54.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:55.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:55.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:55.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:55.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:56.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:56.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:56.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:56.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:57.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:57.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:57.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:57.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:58.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:58.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:58.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:58.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:59.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:20:59.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:20:59.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:20:59.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:00.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:00.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:00.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:00.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:01.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:01.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:01.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:01.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:02.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:02.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:02.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:02.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:03.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:03.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:03.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:03.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:04.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:04.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:04.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:04.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:05.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:05.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:05.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:05.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:06.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:06.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:06.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:06.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:07.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:07.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:07.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:07.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:08.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:08.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:08.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:08.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:09.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:09.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:09.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:09.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:10.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:10.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:10.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:10.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:11.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:11.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:11.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:11.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:12.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:12.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:12.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:12.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:13.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:13.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:13.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:13.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:14.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:14.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:14.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:14.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:15.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:15.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:15.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:15.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:16.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:16.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:16.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:16.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:17.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:17.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:18.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:18.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:18.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:18.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:19.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:19.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:19.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:19.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:20.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:20.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:20.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:20.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:21.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:21.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:21.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:21.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:22.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:22.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:22.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:22.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:23.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:23.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:23.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:23.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:23.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:23.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:24.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:24.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:24.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:24.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:25.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:25.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:25.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:25.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:26.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:26.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:26.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:26.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:27.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:27.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:27.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:27.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:28.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:28.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:28.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:28.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:29.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:29.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:29.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:29.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:30.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:30.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:30.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:30.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:31.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:31.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:31.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:31.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:32.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:32.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:32.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:32.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:33.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:33.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:33.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:33.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:34.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:34.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:34.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:34.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:35.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:35.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:35.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:35.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:36.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:36.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:36.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:36.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:37.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:37.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:37.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:37.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:38.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:38.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:38.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:38.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:39.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:39.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:39.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:39.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:40.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:40.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:40.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:40.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:41.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:41.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:41.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:41.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:42.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:42.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:42.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:42.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:43.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:43.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:43.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:43.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:44.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:44.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:44.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:44.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:45.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:45.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:46.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:46.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:46.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:46.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:46.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:46.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:47.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:47.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:48.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:48.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:48.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:48.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:49.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:49.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:49.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:49.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:50.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:50.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:50.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:50.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:51.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:50.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:51.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:51.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:52.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:52.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:52.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:52.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:53.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:53.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:53.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:53.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:54.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:54.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:54.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:54.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:55.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:55.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:55.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:55.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:56.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:56.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:56.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:56.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:57.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:57.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:57.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:57.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:58.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:58.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:58.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:58.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:59.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:21:59.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:21:59.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:21:59.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:00.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:00.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:00.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:00.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:01.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:01.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:01.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:01.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:02.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:02.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:02.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:02.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:03.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:03.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:03.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:03.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:04.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:04.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:04.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:04.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:05.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:05.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:05.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:05.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:06.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:06.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:06.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:06.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:07.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:07.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:07.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:07.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:08.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:08.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:08.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:08.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:09.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:09.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:09.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:09.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:10.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:10.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:10.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:10.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:11.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:11.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:11.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:11.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:12.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:12.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:12.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:12.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:13.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:13.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:13.514 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T21:22:13.507+0000 7f5fc4669700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6808/29215,v1:172.21.15.163:6809/29215] conn(0x7f5fa40368d0 msgr2=0x7f5fa40ba440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T21:22:13.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:13.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:14.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:14.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:14.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:14.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:15.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:15.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:15.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:15.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:16.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:16.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:16.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:16.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:17.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:17.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:17.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:17.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:18.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:18.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:18.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:18.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:19.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:19.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:19.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:19.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:20.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:20.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:20.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:20.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:21.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:21.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:21.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:21.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:22.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:22.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:22.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:22.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:23.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:23.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:23.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:23.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:24.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:24.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:24.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:24.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:25.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:25.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:25.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:25.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:26.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:26.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:26.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:26.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:27.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:27.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:27.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:27.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:28.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:28.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:28.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:28.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:28.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:28.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:29.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:29.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:30.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:29.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:30.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:30.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:31.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:31.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:31.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:31.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:32.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:32.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:32.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:32.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:33.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:33.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:33.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:33.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:34.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:34.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:34.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:34.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:35.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:35.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:35.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:35.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:36.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:36.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:36.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:36.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:37.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:37.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:37.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:37.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:38.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:38.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:38.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:38.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:39.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:39.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:39.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:39.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:40.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:40.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:40.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:40.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:41.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:41.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:41.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:41.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:42.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:42.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:42.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:42.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:43.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:43.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:43.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:43.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:44.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:44.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:44.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:44.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:45.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:45.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:45.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:45.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:46.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:46.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:46.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:46.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:47.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:47.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:47.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:47.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:48.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:48.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:48.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:48.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:49.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:49.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:49.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:49.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:50.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:50.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:50.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:50.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:51.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:51.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:51.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:51.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:52.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:52.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:52.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:52.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:53.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:53.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:53.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:53.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:54.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:54.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:54.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:54.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:55.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:55.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:55.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:55.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:56.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:56.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:56.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:56.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:57.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:57.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:57.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:57.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:58.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:58.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:58.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:58.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:59.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:22:59.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:22:59.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:22:59.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:00.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:00.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:00.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:00.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:01.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:01.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:01.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:01.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:02.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:02.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:02.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:02.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:03.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:03.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:03.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:03.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:04.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:04.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:04.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:04.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:05.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:05.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:05.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:05.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:06.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:06.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:06.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:06.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:07.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:07.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:07.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:07.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:08.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:08.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:08.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:08.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:09.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:09.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:09.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:09.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:10.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:10.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:10.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:10.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:11.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:11.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:11.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:11.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:12.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:12.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:12.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:12.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:13.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:13.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:13.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:13.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:14.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:14.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:14.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:14.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:15.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:15.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:15.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:15.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:16.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:16.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:16.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:16.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:17.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:17.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:17.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:17.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:18.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:18.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:18.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:18.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:19.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:19.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:19.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:19.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:20.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:20.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:20.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:20.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:21.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:21.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:21.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:21.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:22.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:22.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:22.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:22.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:23.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:23.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:23.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:23.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:24.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:24.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:24.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:24.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:25.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:25.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:25.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:25.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:26.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:26.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:26.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:26.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:27.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:27.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:27.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:27.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:28.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:28.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:28.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:28.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:29.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:29.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:29.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:29.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:30.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:30.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:30.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:30.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:31.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:31.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:31.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:31.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:32.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:32.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:32.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:32.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:33.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:33.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:33.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:33.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:34.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:34.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:34.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:34.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:35.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:35.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:35.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:35.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:36.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:36.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:36.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:36.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:37.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:37.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:37.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:37.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:38.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:38.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:38.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:38.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:39.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:39.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:39.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:39.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:40.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:40.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:40.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:40.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:41.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:41.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:41.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:41.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:42.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:42.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:42.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:42.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:43.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:43.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:43.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:43.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:44.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:44.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:44.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:44.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:45.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:45.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:45.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:45.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:46.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:46.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:46.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:46.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:47.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:47.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:47.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:47.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:48.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:48.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:48.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:48.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:49.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:49.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:49.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:49.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:50.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:50.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:50.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:50.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:51.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:51.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:51.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:51.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:52.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:52.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:52.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:52.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:53.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:53.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:53.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:53.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:54.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:54.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:54.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:54.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:55.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:55.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:55.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:55.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:56.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:56.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:56.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:56.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:57.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:57.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:57.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:57.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:58.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:58.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:58.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:58.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:59.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:23:59.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:23:59.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:23:59.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:00.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:00.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:00.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:00.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:01.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:01.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:01.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:01.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:02.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:02.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:02.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:02.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:03.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:03.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:03.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:03.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:04.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:04.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:04.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:04.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:05.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:05.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:05.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:05.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:06.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:06.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:06.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:06.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:07.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:07.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:07.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:07.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:08.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:08.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:08.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:08.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:09.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:09.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:09.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:09.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:10.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:10.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:10.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:10.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:11.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:11.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:11.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:11.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:12.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:12.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:12.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:12.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:13.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:13.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:13.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:13.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:14.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:14.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:14.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:14.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:15.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:15.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:15.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:15.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:16.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:16.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:16.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:16.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:17.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:17.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:17.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:17.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:18.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:18.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:18.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:18.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:19.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:19.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:19.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:19.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:20.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:20.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:20.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:20.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:21.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:21.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:21.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:21.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:22.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:22.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:22.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:22.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:23.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:23.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:23.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:23.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:24.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:24.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:24.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:24.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:25.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:25.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:25.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:25.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:26.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:26.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:26.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:26.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:27.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:27.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:27.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:27.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:28.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:28.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:28.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:28.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:29.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:29.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:29.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:29.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:30.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:30.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:30.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:30.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:31.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:31.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:31.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:31.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:32.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:32.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:32.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:32.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:33.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:33.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:33.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:33.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:34.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:34.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:34.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:34.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:35.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:35.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:35.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:35.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:36.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:36.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:36.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:36.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:37.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:37.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:37.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:37.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:37.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:37.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:38.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:38.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:38.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:39.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:39.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:40.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:39.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:40.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:40.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:41.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:41.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:41.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:41.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:42.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:41.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:42.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:42.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:43.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:43.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:43.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:43.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:44.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:44.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:44.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:44.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:44.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:44.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:45.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:45.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:46.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:45.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:46.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:46.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:46.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:46.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:47.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:47.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:47.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:47.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:48.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:48.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:48.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:48.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:49.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:49.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:50.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:50.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:50.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:50.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:51.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:51.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:51.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:51.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:52.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:52.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:52.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:52.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:53.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:53.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:53.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:53.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:54.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:54.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:54.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:54.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:55.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:55.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:55.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:55.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:56.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:56.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:56.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:56.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:57.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:57.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:57.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:57.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:57.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:57.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:58.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:58.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:58.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:58.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:59.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:24:59.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:24:59.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:24:59.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:00.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:00.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:01.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:01.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:01.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:01.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:02.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:02.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:02.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:02.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:03.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:03.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:03.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:03.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:04.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:04.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:05.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:05.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:05.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:05.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:06.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:06.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:06.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:06.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:06.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:06.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:07.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:07.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:07.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:07.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:08.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:08.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:08.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:08.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:09.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:09.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:09.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:09.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:10.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:10.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:10.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:10.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:11.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:11.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:12.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:11.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:12.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:12.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:12.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:12.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:13.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:13.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:13.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:13.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:14.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:14.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:14.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:14.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:15.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:15.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:15.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:15.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:16.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:16.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:16.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:16.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:17.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:17.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:17.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:17.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:18.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:18.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:18.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:18.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:19.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:19.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:19.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:19.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:20.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:20.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:20.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:20.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:21.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:21.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:21.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:21.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:22.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:22.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:22.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:22.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:23.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:23.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:23.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:23.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:24.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:24.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:24.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:24.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:25.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:25.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:25.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:25.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:26.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:26.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:27.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:27.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:27.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:27.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:27.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:27.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:28.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:28.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:28.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:28.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:28.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:28.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:29.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:29.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:30.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:30.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:31.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:31.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:31.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:31.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:32.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:32.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:32.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:32.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:32.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:32.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:33.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:33.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:34.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:34.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:34.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:34.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:35.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:34.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:35.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:35.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:36.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:36.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:36.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:36.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:37.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:37.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:37.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:37.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:38.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:38.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:38.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:38.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:39.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:39.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:39.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:39.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:39.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:39.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:40.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:40.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:40.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:40.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:41.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:41.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:41.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:41.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:42.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:42.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:43.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:43.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:43.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:43.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:43.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:43.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:44.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:44.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:44.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:44.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:45.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:45.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:45.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:45.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:46.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:46.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:46.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:46.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:47.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:47.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:47.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:47.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:48.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:48.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:48.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:48.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:49.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:49.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:49.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:49.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:50.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:50.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:50.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:50.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:51.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:51.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:51.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:51.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:52.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:52.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:52.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:52.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:53.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:53.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:53.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:53.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:54.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:54.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:54.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:54.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:55.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:55.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:55.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:55.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:56.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:56.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:56.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:56.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:57.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:57.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:57.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:57.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:58.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:58.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:58.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:58.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:59.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:25:59.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:25:59.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:25:59.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:00.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:00.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:00.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:00.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:01.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:01.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:01.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:01.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:02.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:02.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:02.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:02.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:03.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:03.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:03.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:03.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:04.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:04.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:05.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:05.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:05.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:05.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:06.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:06.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:06.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:06.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:07.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:07.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:07.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:07.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:07.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:07.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:08.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:08.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:09.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:09.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:09.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:09.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:09.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:09.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:10.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:10.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:11.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:11.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:11.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:11.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:12.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:12.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:12.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:12.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:13.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:13.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:13.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:13.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:14.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:14.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:14.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:14.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:15.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:15.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:15.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:15.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:16.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:16.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:16.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:16.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:17.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:17.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:17.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:17.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:18.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:18.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:18.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:18.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:19.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:19.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:19.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:19.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:20.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:20.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:20.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:20.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:21.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:21.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:21.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:21.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:22.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:22.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:22.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:22.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:23.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:23.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:23.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:23.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:24.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:24.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:24.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:24.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:25.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:25.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:25.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:25.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:26.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:26.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:26.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:26.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:27.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:27.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:27.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:27.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:28.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:28.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:28.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:28.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:29.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:29.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:29.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:29.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:30.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:30.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:30.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:30.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:31.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:31.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:31.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:31.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:32.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:32.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:32.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:32.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:32.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:32.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:33.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:33.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:34.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:34.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:34.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:34.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:34.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:34.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:35.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:35.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:36.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:36.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:36.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:36.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:37.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:37.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:37.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:37.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:38.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:38.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:38.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:38.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:39.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:39.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:39.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:39.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:40.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:40.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:40.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:40.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:41.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:41.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:41.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:41.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:42.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:42.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:42.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:42.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:43.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:43.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:43.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:43.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:44.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:44.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:44.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:44.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:45.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:45.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:45.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:45.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:46.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:46.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:46.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:46.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:47.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:47.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:47.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:47.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:48.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:48.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:48.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:48.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:49.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:49.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:49.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:49.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:50.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:50.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:50.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:50.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:51.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:51.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:51.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:51.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:52.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:52.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:52.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:52.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:53.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:53.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:53.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:53.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:54.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:54.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:54.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:54.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:55.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:55.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:55.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:55.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:56.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:56.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:56.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:56.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:57.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:57.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:57.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:57.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:58.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:58.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:58.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:58.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:59.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:26:59.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:26:59.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:26:59.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:00.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:00.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:00.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:00.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:01.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:01.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:01.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:01.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:02.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:02.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:02.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:02.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:03.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:03.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:03.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:03.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:04.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:04.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:04.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:04.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:05.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:05.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:05.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:05.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:06.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:06.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:06.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:06.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:07.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:07.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:07.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:07.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:08.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:08.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:08.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:08.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:09.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:09.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:09.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:09.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:10.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:10.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:10.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:10.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:11.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:11.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:11.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:11.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:12.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:12.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:12.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:12.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:13.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:13.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:13.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:13.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:14.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:14.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:14.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:14.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:15.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:15.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:15.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:15.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:16.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:16.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:16.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:16.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:17.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:17.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:17.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:17.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:18.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:18.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:18.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:18.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:19.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:19.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:19.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:19.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:20.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:20.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:20.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:20.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:21.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:21.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:21.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:21.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:22.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:22.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:22.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:22.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:23.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:23.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:23.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:23.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:24.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:24.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:24.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:24.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:25.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:25.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:25.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:25.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:26.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:26.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:26.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:26.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:27.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:27.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:27.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:27.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:28.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:28.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:28.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:28.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:29.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:29.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:29.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:29.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:30.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:30.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:30.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:30.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:31.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:31.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:31.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:31.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:32.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:32.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:32.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:32.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:33.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:33.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:33.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:33.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:34.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:34.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:34.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:34.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:35.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:35.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:35.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:35.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:36.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:36.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:36.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:36.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:37.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:37.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:37.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:37.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:38.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:38.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:38.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:38.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:39.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:39.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:39.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:39.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:40.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:40.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:40.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:40.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:41.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:41.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:41.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:41.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:42.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:42.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:42.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:42.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:43.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:43.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:43.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:43.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:44.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:44.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:44.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:44.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:45.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:45.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:45.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:45.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:46.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:46.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:46.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:46.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:47.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:47.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:47.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:47.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:48.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:48.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:48.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:48.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:49.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:49.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:49.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:49.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:50.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:50.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:50.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:50.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:51.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:51.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:51.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:51.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:52.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:52.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:52.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:52.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:52.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:52.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:53.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:53.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:53.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:53.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:54.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:54.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:54.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:54.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:55.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:55.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:55.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:55.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:56.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:56.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:56.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:56.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:57.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:57.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:57.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:57.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:58.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:58.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:58.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:58.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:59.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:27:59.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:27:59.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:27:59.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:00.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:00.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:00.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:00.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:01.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:01.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:01.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:01.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:02.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:02.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:02.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:02.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:03.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:03.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:03.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:03.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:04.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:04.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:04.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:04.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:05.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:05.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:05.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:05.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:06.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:06.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:06.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:06.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:07.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:07.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:07.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:07.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:08.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:08.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:08.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:08.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:09.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:09.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:09.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:09.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:10.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:10.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:10.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:10.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:11.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:11.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:11.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:11.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:12.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:12.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:12.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:12.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:13.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:13.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:13.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:13.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:14.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:14.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:14.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:14.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:15.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:15.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:15.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:15.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:16.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:16.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:16.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:16.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:17.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:17.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:17.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:17.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:18.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:18.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:18.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:18.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:19.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:19.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:19.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:19.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:20.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:20.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:20.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:20.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:21.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:21.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:21.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:21.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:22.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:22.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:23.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:23.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:23.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:23.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:24.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:24.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:24.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:24.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:25.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:25.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:25.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:25.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:26.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:26.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:26.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:26.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:27.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:27.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:27.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:27.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:28.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:28.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:28.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:28.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:29.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:29.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:29.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:29.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:30.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:30.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:30.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:30.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:31.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:31.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:31.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:31.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:32.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:32.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:32.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:32.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:33.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:33.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:33.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:33.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:34.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:34.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:34.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:34.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:35.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:35.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:35.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:35.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:36.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:36.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:36.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:36.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:37.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:37.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:37.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:37.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:38.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:38.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:38.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:38.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:39.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:39.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:39.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:39.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:40.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:40.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:40.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:40.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:41.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:41.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:41.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:41.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:42.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:42.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:42.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:42.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:43.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:43.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:43.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:43.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:44.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:44.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:44.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:44.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:45.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:45.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:45.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:45.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:46.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:46.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:46.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:46.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:47.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:47.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:47.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:47.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:48.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:48.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:48.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:48.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:49.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:49.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:49.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:49.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:50.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:50.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:50.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:50.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:51.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:51.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:51.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:51.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:52.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:52.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:52.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:52.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:53.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:53.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:53.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:53.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:54.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:54.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:54.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:54.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:55.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:55.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:55.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:55.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:56.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:56.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:56.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:57.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:57.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:57.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:57.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:58.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:58.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:58.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:58.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:59.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:28:59.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:28:59.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:28:59.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:00.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:00.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:00.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:00.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:01.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:01.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:01.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:01.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:02.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:02.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:02.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:02.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:03.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:03.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:03.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:03.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:04.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:04.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:04.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:04.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:05.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:05.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:05.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:05.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:06.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:06.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:06.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:06.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:07.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:07.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:07.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:07.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:08.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:08.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:08.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:08.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:09.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:09.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:09.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:09.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:10.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:10.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:10.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:10.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:11.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:11.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:11.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:11.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:12.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:12.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:12.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:12.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:13.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:13.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:13.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:13.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:14.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:14.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:14.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:14.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:15.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:15.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:15.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:15.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:16.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:16.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:16.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:16.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:17.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:17.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:17.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:17.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:18.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:18.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:18.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:18.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:19.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:19.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:19.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:19.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:20.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:20.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:20.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:20.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:21.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:21.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:21.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:21.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:22.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:22.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:22.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:22.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:23.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:23.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:23.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:23.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:24.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:24.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:24.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:24.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:25.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:25.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:25.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:25.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:26.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:26.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:26.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:26.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:27.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:27.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:27.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:27.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:28.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:28.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:28.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:28.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:29.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:29.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:29.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:29.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:30.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:30.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:30.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:30.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:31.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:31.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:31.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:31.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:32.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:32.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:32.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:32.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:33.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:33.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:33.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:33.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:34.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:34.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:34.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:34.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:35.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:35.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:35.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:35.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:36.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:36.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:36.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:36.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:37.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:37.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:37.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:37.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:38.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:38.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:38.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:38.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:39.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:39.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:39.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:39.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:40.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:40.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:40.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:40.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:41.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:41.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:41.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:41.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:42.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:42.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:42.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:42.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:43.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:43.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:43.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:43.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:44.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:44.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:44.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:44.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:45.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:45.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:45.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:45.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:46.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:46.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:46.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:46.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:47.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:47.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:47.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:47.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:48.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:48.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:48.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:48.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:49.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:49.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:49.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:49.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:50.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:50.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:50.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:50.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:51.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:51.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:51.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:51.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:52.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:52.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:52.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:52.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:53.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:53.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:53.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:53.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:54.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:54.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:54.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:54.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:55.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:55.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:55.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:55.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:56.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:56.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:56.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:56.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:57.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:57.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:57.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:57.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:58.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:58.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:58.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:58.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:59.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:29:59.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:29:59.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:29:59.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:00.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:00.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:00.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:00.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:01.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:01.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:01.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:01.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:02.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:02.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:02.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:02.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:03.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:03.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:03.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:03.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:04.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:04.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:04.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:04.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:05.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:05.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:05.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:05.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:06.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:06.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:06.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:06.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:07.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:07.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:07.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:07.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:08.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:08.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:08.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:08.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:09.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:09.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:09.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:09.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:10.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:10.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:10.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:10.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:11.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:11.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:11.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:11.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:12.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:12.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:12.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:12.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:13.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:13.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:13.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:13.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:14.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:14.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:14.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:14.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:15.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:15.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:15.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:15.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:16.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:16.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:16.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:16.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:17.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:17.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:17.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:17.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:18.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:18.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:18.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:18.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:19.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:19.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:19.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:19.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:20.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:20.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:20.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:20.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:21.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:21.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:21.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:21.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:22.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:22.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:22.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:22.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:23.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:23.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:23.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:23.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:24.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:24.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:24.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:24.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:25.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:25.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:25.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:25.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:26.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:26.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:26.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:26.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:27.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:27.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:27.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:27.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:28.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:28.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:28.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:28.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:29.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:29.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:29.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:29.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:30.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:30.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:30.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:30.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:31.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:31.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:31.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:31.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:32.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:32.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:32.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:32.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:33.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:33.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:33.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:33.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:34.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:34.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:34.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:34.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:35.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:35.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:35.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:35.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:36.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:36.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:36.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:36.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:37.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:37.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:37.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:37.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:38.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:38.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:38.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:38.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:39.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:39.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:39.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:39.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:40.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:40.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:40.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:40.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:41.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:41.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:41.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:41.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:42.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:42.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:42.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:42.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:43.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:43.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:43.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:43.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:44.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:44.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:44.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:44.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:45.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:45.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:45.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:45.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:46.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:46.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:46.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:46.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:47.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:47.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:47.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:47.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:48.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:48.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:48.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:48.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:49.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:49.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:49.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:49.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:50.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:50.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:50.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:50.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:51.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:51.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:51.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:51.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:52.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:52.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:52.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:52.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:53.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:53.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:53.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:53.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:54.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:54.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:54.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:54.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:55.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:55.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:55.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:55.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:56.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:56.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:56.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:56.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:57.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:57.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:57.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:57.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:58.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:58.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:58.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:58.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:59.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:30:59.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:30:59.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:30:59.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:00.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:00.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:00.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:00.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:01.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:01.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:01.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:01.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:02.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:02.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:02.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:02.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:03.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:03.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:03.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:03.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:04.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:04.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:04.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:04.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:05.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:05.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:05.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:05.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:06.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:06.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:06.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:06.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:07.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:07.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:07.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:07.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:08.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:08.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:08.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:08.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:09.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:09.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:09.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:09.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:10.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:10.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:10.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:10.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:11.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:11.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:11.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:11.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:12.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:12.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:12.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:12.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:13.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:13.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:13.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:13.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:14.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:14.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:14.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:14.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:15.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:15.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:15.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:15.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:16.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:16.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:16.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:16.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:17.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:17.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:17.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:17.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:18.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:18.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:18.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:18.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:19.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:19.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:20.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:19.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:20.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:20.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:21.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:21.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:21.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:21.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:22.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:22.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:22.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:22.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:22.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:22.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:23.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:23.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:24.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:24.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:24.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:24.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:25.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:25.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:25.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:25.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:26.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:26.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:26.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:26.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:27.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:27.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:27.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:27.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:28.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:28.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:28.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:28.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:29.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:29.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:29.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:29.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:30.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:30.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:30.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:30.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:31.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:31.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:31.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:31.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:32.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:32.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:32.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:32.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:33.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:33.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:33.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:33.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:33.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:33.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:34.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:34.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:35.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:35.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:35.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:35.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:35.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:35.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:36.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:36.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:37.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:36.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:37.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:37.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:37.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:37.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:38.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:38.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:38.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:38.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:39.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:39.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:39.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:39.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:40.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:40.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:40.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:40.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:41.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:41.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:41.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:41.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:42.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:42.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:42.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:42.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:43.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:43.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:43.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:43.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:44.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:44.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:45.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:45.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:45.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:45.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:46.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:46.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:46.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:46.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:47.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:47.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:47.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:47.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:48.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:48.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:48.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:48.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:49.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:49.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:49.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:49.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:50.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:50.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:50.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:50.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:51.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:51.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:51.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:51.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:52.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:52.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:52.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:52.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:53.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:53.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:53.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:53.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:54.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:54.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:54.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:54.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:55.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:55.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:55.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:55.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:56.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:56.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:56.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:56.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:57.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:57.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:57.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:57.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:58.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:58.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:58.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:58.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:59.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:31:59.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:31:59.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:31:59.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:00.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:00.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:00.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:01.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:01.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:01.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:01.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:02.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:02.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:02.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:02.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:03.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:03.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:03.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:03.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:04.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:04.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:04.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:04.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:05.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:05.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:05.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:05.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:06.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:06.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:06.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:06.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:07.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:07.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:07.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:07.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:08.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:08.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:08.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:08.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:09.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:09.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:09.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:09.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:10.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:10.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:10.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:10.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:11.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:11.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:11.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:11.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:12.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:12.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:12.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:12.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:13.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:13.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:13.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:13.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:14.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:14.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:14.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:14.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:15.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:15.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:15.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:15.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:16.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:16.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:16.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:16.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:17.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:17.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:17.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:17.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:18.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:18.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:18.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:18.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:19.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:19.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:19.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:19.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:20.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:20.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:20.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:20.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:21.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:21.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:21.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:21.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:22.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:22.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:22.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:22.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:22.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:22.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:23.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:23.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:23.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:23.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:24.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:24.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:24.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:24.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:25.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:25.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:25.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:25.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:26.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:26.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:27.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:27.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:27.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:27.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:27.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:27.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:28.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:28.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:29.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:29.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:29.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:29.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:30.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:30.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:30.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:30.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:31.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:31.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:31.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:31.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:32.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:32.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:33.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:33.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:33.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:33.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:34.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:34.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:34.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:34.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:35.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:35.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:35.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:35.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:36.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:36.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:36.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:36.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:37.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:37.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:37.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:37.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:38.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:38.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:38.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:38.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:39.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:39.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:39.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:39.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:39.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:39.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:40.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:40.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:41.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:41.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:41.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:41.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:42.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:42.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:42.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:42.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:43.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:42.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:43.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:43.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:43.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:43.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:44.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:44.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:44.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:44.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:45.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:45.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:46.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:46.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:46.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:46.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:47.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:47.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:47.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:47.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:48.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:48.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:48.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:48.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:49.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:48.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:49.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:49.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:49.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:49.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:50.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:50.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:50.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:50.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:51.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:51.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:51.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:51.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:52.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:52.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:52.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:52.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:53.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:53.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:53.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:53.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:54.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:54.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:54.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:54.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:55.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:55.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:55.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:55.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:56.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:56.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:56.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:56.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:57.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:57.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:57.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:57.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:58.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:58.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:58.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:58.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:59.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:32:59.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:32:59.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:32:59.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:00.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:00.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:00.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:00.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:01.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:01.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:01.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:01.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:02.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:02.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:02.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:02.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:03.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:03.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:03.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:03.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:04.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:04.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:04.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:04.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:05.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:05.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:05.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:05.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:06.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:06.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:06.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:06.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:07.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:07.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:07.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:07.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:08.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:08.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:08.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:08.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:09.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:09.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:09.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:09.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:10.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:10.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:10.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:10.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:11.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:11.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:11.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:11.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:12.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:12.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:12.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:12.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:13.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:13.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:13.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:13.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:14.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:14.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:14.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:14.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:15.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:15.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:15.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:15.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:15.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:15.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:16.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:16.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:16.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:16.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:17.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:17.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:18.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:18.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:18.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:18.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:18.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:18.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:19.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:19.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:20.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:20.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:20.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:20.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:21.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:20.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:21.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:21.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:22.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:22.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:22.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:22.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:23.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:23.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:23.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:23.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:24.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:24.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:24.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:24.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:25.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:25.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:25.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:25.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:26.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:26.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:26.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:27.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:27.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:27.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:27.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:28.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:28.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:29.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:29.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:29.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:29.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:30.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:30.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:30.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:30.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:30.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:30.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:31.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:31.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:31.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:31.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:31.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:31.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:32.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:32.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:33.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:33.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:33.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:33.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:33.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:33.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:34.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:34.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:34.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:34.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:35.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:35.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:35.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:35.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:36.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:36.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:37.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:37.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:37.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:37.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:38.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:38.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:38.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:38.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:39.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:39.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:39.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:39.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:40.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:40.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:40.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:40.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:41.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:40.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:41.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:41.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:42.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:41.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:42.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:42.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:43.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:43.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:43.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:43.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:43.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:43.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:44.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:44.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:45.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:45.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:45.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:45.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:45.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:45.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:46.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:46.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:46.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:46.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:47.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:47.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:47.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:47.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:48.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:48.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:48.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:48.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:49.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:49.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:50.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:50.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:50.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:50.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:51.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:51.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:51.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:51.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:52.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:52.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:52.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:52.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:53.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:53.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:53.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:53.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:54.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:54.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:54.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:54.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:55.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:55.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:55.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:55.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:56.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:56.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:56.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:56.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:57.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:57.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:57.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:57.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:58.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:58.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:58.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:58.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:59.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:33:59.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:33:59.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:33:59.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:00.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:00.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:00.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:00.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:01.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:01.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:01.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:01.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:02.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:02.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:02.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:02.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:02.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:02.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:03.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:03.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:03.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:03.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:04.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:04.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:04.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:04.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:05.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:05.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:05.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:05.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:06.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:06.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:06.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:06.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:07.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:07.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:07.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:07.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:08.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:08.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:08.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:08.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:09.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:09.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:10.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:10.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:10.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:10.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:10.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:10.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:11.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:11.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:12.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:12.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:12.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:12.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:13.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:13.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:13.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:13.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:14.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:14.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:14.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:14.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:15.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:15.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:16.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:16.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:16.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:16.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:17.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:17.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:17.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:17.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:18.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:18.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:18.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:18.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:19.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:19.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:19.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:19.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:20.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:20.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:20.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:20.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:21.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:21.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:21.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:21.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:22.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:22.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:22.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:22.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:23.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:23.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:23.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:23.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:24.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:24.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:24.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:24.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:25.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:25.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:25.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:25.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:26.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:26.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:26.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:26.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:27.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:27.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:27.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:27.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:28.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:28.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:28.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:28.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:29.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:29.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:29.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:29.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:30.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:30.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:30.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:30.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:31.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:31.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:31.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:31.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:32.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:32.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:32.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:32.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:33.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:33.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:33.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:33.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:34.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:34.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:34.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:34.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:35.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:35.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:35.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:35.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:36.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:36.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:36.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:36.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:37.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:37.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:37.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:37.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:38.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:38.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:38.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:38.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:39.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:39.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:39.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:39.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:40.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:40.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:40.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:40.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:41.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:41.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:41.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:41.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:42.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:42.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:42.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:42.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:43.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:43.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:43.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:43.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:44.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:44.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:44.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:44.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:45.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:45.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:45.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:45.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:46.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:46.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:46.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:46.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:47.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:47.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:47.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:47.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:48.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:48.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:48.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:48.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:49.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:49.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:49.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:49.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:50.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:50.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:50.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:50.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:51.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:51.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:51.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:51.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:52.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:52.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:52.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:52.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:53.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:53.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:53.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:53.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:54.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:54.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:54.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:54.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:55.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:55.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:55.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:55.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:56.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:56.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:56.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:56.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:57.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:57.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:57.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:57.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:58.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:58.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:58.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:58.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:59.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:34:59.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:34:59.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:34:59.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:00.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:00.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:00.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:00.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:01.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:01.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:01.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:01.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:02.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:02.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:02.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:02.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:03.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:03.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:03.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:03.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:04.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:04.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:04.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:04.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:05.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:05.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:05.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:05.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:06.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:06.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:06.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:06.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:07.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:07.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:07.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:07.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:08.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:08.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:08.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:08.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:09.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:09.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:09.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:09.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:10.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:10.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:10.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:10.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:11.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:11.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:11.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:11.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:12.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:12.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:12.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:12.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:13.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:13.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:13.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:13.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:14.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:14.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:14.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:14.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:15.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:15.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:15.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:15.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:16.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:16.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:16.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:16.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:17.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:17.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:17.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:17.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:18.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:18.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:18.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:18.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:19.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:19.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:19.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:19.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:20.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:20.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:20.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:20.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:21.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:21.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:21.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:21.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:22.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:22.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:22.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:22.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:23.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:23.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:23.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:23.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:24.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:24.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:24.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:24.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:25.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:25.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:25.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:25.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:26.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:26.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:26.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:26.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:27.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:27.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:27.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:27.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:28.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:28.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:28.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:28.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:29.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:29.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:29.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:29.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:30.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:30.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:30.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:30.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:31.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:31.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:31.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:31.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:32.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:32.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:32.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:32.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:33.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:33.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:33.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:33.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:34.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:34.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:34.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:34.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:35.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:35.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:35.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:35.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:36.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:36.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:36.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:36.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:37.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:37.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:37.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:37.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:38.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:38.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:38.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:38.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:39.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:39.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:39.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:39.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:40.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:40.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:40.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:40.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:41.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:41.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:41.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:41.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:42.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:42.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:42.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:42.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:43.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:43.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:43.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:43.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:44.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:44.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:44.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:44.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:45.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:45.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:45.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:45.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:46.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:46.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:46.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:46.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:47.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:47.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:47.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:47.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:48.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:48.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:48.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:48.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:49.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:49.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:49.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:49.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:50.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:50.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:50.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:50.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:51.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:51.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:51.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:51.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:52.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:52.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:52.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:52.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:53.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:53.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:53.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:53.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:54.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:54.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:54.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:54.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:55.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:55.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:55.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:55.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:56.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:56.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:56.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:56.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:57.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:57.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:57.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:57.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:58.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:58.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:58.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:58.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:59.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:35:59.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:35:59.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:35:59.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:00.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:00.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:00.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:00.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:01.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:01.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:02.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:01.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:02.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:02.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:02.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:02.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:03.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:03.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:03.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:03.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:04.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:04.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:04.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:04.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:05.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:05.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:05.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:05.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:06.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:06.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:06.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:06.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:07.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:07.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:07.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:07.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:08.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:08.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:08.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:08.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:09.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:09.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:09.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:09.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:10.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:10.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:11.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:11.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:11.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:11.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:12.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:12.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:12.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:12.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:12.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:12.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:13.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:13.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:14.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:14.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:14.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:14.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:15.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:15.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:15.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:15.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:16.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:16.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:16.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:16.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:17.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:17.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:17.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:17.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:18.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:18.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:18.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:18.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:19.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:19.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:19.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:19.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:20.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:20.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:20.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:20.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:21.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:21.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:21.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:21.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:22.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:22.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:22.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:22.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:23.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:23.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:23.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:23.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:24.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:24.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:24.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:24.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:25.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:25.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:25.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:25.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:26.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:26.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:26.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:26.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:27.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:26.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:27.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:27.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:28.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:27.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:28.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:28.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:29.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:28.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:29.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:29.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:30.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:30.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:30.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:30.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:31.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:31.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:31.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:31.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:32.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:32.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:32.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:32.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:33.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:33.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:33.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:33.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:34.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:34.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:34.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:34.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:35.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:35.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:35.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:35.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:36.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:36.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:36.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:36.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:37.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:37.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:37.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:37.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:38.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:38.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:38.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:38.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:39.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:39.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:39.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:39.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:40.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:40.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:40.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:40.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:41.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:41.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:41.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:41.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:42.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:42.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:42.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:42.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:43.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:43.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:43.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:43.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:44.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:44.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:44.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:44.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:45.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:45.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:45.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:45.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:46.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:46.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:46.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:46.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:47.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:47.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:47.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:47.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:48.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:48.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:48.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:48.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:49.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:49.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:49.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:49.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:50.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:50.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:50.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:50.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:51.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:51.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:51.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:51.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:52.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:52.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:52.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:52.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:53.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:53.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:53.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:53.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:54.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:54.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:54.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:54.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:55.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:55.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:55.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:55.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:56.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:56.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:56.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:57.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:57.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:57.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:57.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:58.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:58.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:58.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:58.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:59.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:36:59.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:36:59.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:36:59.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:00.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:00.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:00.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:00.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:01.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:01.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:01.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:01.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:02.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:02.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:02.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:02.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:03.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:03.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:03.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:03.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:04.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:04.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:04.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:04.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:05.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:05.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:05.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:05.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:06.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:06.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:06.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:06.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:07.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:07.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:07.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:07.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:08.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:08.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:08.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:08.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:09.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:09.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:09.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:09.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:10.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:10.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:10.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:10.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:11.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:11.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:11.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:11.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:12.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:12.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:12.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:12.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:13.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:13.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:13.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:13.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:14.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:14.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:14.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:14.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:15.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:15.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:15.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:15.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:16.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:16.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:16.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:16.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:17.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:17.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:17.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:17.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:18.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:18.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:18.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:18.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:19.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:19.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:19.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:19.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:20.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:20.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:20.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:20.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:21.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:21.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:21.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:21.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:22.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:22.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:22.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:22.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:23.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:23.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:23.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:23.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:24.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:24.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:24.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:24.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:25.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:25.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:25.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:25.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:26.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:26.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:26.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:26.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:27.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:27.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:27.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:27.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:28.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:28.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:28.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:28.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:29.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:29.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:29.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:29.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:30.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:30.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:30.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:30.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:31.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:31.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:31.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:31.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:32.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:32.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:32.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:32.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:33.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:33.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:33.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:33.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:34.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:34.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:34.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:34.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:35.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:35.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:35.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:35.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:36.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:36.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:36.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:36.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:37.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:37.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:37.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:37.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:38.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:38.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:38.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:38.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:39.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:39.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:39.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:39.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:40.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:40.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:40.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:40.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:41.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:41.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:41.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:41.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:42.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:42.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:42.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:42.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:43.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:43.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:43.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:43.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:44.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:44.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:44.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:44.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:45.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:45.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:45.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:45.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:46.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:46.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:46.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:46.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:47.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:47.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:47.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:47.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:48.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:48.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:48.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:48.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:49.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:49.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:49.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:49.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:50.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:50.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:50.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:50.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:51.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:51.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:51.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:51.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:52.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:52.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:52.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:52.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:53.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:53.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:53.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:53.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:54.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:54.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:54.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:54.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:55.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:55.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:55.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:55.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:56.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:56.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:56.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:56.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:57.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:57.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:57.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:57.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:58.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:58.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:58.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:58.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:59.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:37:59.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:37:59.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:37:59.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:00.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:00.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:00.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:00.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:01.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:01.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:01.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:01.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:02.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:02.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:02.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:02.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:03.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:03.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:03.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:03.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:04.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:04.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:04.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:04.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:05.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:05.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:05.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:05.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:06.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:06.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:06.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:06.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:07.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:07.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:07.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:07.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:08.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:08.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:08.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:08.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:09.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:09.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:10.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:10.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:10.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:10.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:11.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:11.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:11.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:11.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:12.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:12.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:12.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:12.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:13.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:13.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:13.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:13.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:14.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:14.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:14.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:14.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:15.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:15.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:15.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:15.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:16.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:16.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:16.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:16.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:17.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:17.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:17.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:17.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:18.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:18.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:18.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:18.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:19.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:19.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:19.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:19.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:20.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:20.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:20.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:20.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:21.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:21.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:21.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:21.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:22.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:22.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:22.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:22.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:23.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:23.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:23.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:23.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:24.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:24.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:24.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:24.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:25.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:25.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:25.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:25.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:25.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:25.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:26.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:26.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:26.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:26.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:27.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:27.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:28.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:28.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:28.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:28.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:29.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:29.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:29.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:29.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:30.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:30.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:30.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:30.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:31.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:31.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:31.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:31.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:32.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:32.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:32.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:32.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:33.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:33.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:33.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:33.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:34.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:34.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:34.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:34.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:35.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:35.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:35.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:35.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:36.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:36.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:36.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:36.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:37.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:37.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:37.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:37.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:38.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:38.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:38.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:38.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:39.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:39.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:39.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:39.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:40.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:40.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:40.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:40.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:41.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:41.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:41.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:41.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:42.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:42.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:42.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:42.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:43.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:43.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:43.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:43.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:44.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:43.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:44.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:44.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:44.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:44.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:45.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:45.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:45.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:45.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:46.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:46.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:46.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:46.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:47.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:47.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:47.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:47.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:48.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:48.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:48.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:48.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:49.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:49.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:49.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:49.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:50.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:50.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:50.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:50.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:51.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:51.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:51.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:51.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:52.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:52.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:52.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:52.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:53.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:53.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:53.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:53.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:54.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:54.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:54.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:54.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:55.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:55.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:55.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:55.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:56.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:56.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:56.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:56.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:57.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:57.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:57.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:57.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:58.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:58.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:58.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:58.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:59.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:38:59.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:38:59.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:38:59.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:00.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:00.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:00.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:00.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:01.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:01.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:01.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:01.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:02.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:02.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:02.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:02.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:03.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:03.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:03.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:03.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:04.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:04.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:04.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:04.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:05.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:05.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:05.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:05.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:06.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:06.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:06.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:06.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:07.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:07.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:08.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:08.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:08.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:08.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:09.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:09.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:09.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:09.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:10.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:10.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:10.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:10.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:11.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:11.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:11.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:11.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:12.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:12.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:12.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:12.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:13.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:13.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:13.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:13.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:14.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:14.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:14.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:14.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:15.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:15.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:15.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:15.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:16.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:16.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:16.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:16.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:17.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:17.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:17.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:17.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:18.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:18.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:18.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:18.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:19.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:19.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:19.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:19.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:20.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:20.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:20.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:20.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:21.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:21.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:21.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:21.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:22.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:22.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:22.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:22.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:23.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:23.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:23.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:23.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:24.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:24.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:24.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:24.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:25.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:25.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:25.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:25.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:26.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:26.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:26.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:26.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:27.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:27.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:27.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:27.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:28.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:28.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:28.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:28.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:29.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:29.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:29.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:29.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:30.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:30.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:30.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:30.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:31.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:31.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:31.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:31.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:32.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:32.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:32.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:32.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:33.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:33.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:33.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:33.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:34.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:34.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:34.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:34.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:35.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:35.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:35.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:35.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:36.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:36.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:36.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:36.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:37.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:37.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:37.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:37.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:38.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:38.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:38.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:38.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:39.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:39.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:39.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:39.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:40.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:40.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:40.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:40.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:41.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:41.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:41.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:41.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:42.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:42.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:42.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:42.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:42.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:42.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:43.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:43.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:43.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:43.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:44.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:44.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:44.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:44.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:45.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:45.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:45.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:45.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:46.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:46.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:46.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:46.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:47.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:47.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:47.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:47.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:48.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:48.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:49.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:48.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:49.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:49.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:49.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:49.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:50.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:50.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:51.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:51.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:51.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:51.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:52.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:52.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:52.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:52.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:53.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:53.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:53.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:53.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:54.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:54.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:54.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:54.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:55.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:55.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:56.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:56.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:56.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:56.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:56.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:56.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:57.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:57.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:58.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:57.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:58.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:58.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:59.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:39:59.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:39:59.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:39:59.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:00.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:00.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:00.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:00.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:00.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:00.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:01.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:01.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:01.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:01.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:02.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:02.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:02.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:02.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:03.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:03.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:03.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:03.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:04.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:04.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:04.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:04.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:05.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:05.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:05.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:05.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:06.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:06.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:06.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:06.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:07.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:07.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:07.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:07.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:08.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:08.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:08.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:08.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:09.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:09.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:09.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:09.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:10.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:10.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:10.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:10.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:11.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:11.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:11.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:11.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:12.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:12.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:12.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:12.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:13.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:13.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:13.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:13.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:14.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:14.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:14.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:14.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:15.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:15.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:15.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:15.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:15.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:15.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:16.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:16.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:16.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:16.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:17.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:17.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:18.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:18.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:18.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:18.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:19.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:19.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:19.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:19.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:20.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:20.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:20.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:20.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:21.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:21.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:21.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:21.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:22.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:22.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:22.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:22.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:23.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:23.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:23.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:23.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:24.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:24.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:24.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:24.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:25.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:25.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:25.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:25.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:26.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:26.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:27.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:26.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:27.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:27.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:27.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:27.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:28.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:28.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:29.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:29.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:29.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:29.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:30.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:30.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:30.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:30.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:30.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:30.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:31.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:31.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:32.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:31.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:32.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:32.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:33.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:33.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:33.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:33.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:34.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:34.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:34.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:34.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:35.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:35.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:35.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:35.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:36.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:36.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:36.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:36.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:37.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:37.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:37.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:37.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:38.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:38.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:38.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:38.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:39.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:39.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:39.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:39.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:40.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:40.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:40.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:40.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:41.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:41.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:41.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:41.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:42.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:42.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:42.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:42.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:43.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:43.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:43.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:43.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:44.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:44.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:44.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:44.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:45.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:45.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:45.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:45.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:46.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:46.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:46.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:46.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:47.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:47.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:47.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:47.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:48.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:48.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:48.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:48.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:49.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:49.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:49.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:49.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:50.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:50.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:50.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:50.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:51.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:51.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:51.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:51.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:52.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:52.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:52.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:52.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:53.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:53.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:53.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:53.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:54.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:54.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:54.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:54.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:55.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:55.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:55.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:55.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:56.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:56.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:56.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:56.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:57.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:57.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:57.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:57.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:58.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:58.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:58.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:58.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:59.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:40:59.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:40:59.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:40:59.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:00.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:00.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:00.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:00.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:01.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:01.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:01.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:01.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:02.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:02.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:02.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:02.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:03.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:03.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:03.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:03.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:04.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:04.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:04.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:04.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:05.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:05.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:05.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:05.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:06.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:06.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:06.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:06.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:07.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:07.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:07.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:07.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:08.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:08.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:08.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:08.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:09.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:09.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:09.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:09.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:10.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:10.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:10.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:10.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:11.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:11.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:11.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:11.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:12.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:12.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:12.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:12.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:13.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:13.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:13.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:13.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:14.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:14.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:14.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:14.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:15.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:15.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:15.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:15.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:16.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:16.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:16.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:16.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:17.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:17.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:17.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:17.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:18.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:18.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:18.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:18.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:19.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:19.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:19.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:19.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:20.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:20.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:20.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:20.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:21.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:21.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:21.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:21.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:22.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:22.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:22.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:22.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:23.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:23.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:23.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:23.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:24.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:24.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:24.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:24.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:25.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:25.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:25.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:25.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:26.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:26.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:26.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:26.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:27.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:27.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:27.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:27.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:28.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:28.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:28.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:28.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:29.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:29.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:29.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:29.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:30.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:30.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:30.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:30.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:31.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:31.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:31.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:31.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:32.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:32.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:32.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:32.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:33.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:33.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:33.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:33.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:34.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:34.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:34.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:34.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:35.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:35.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:35.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:35.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:36.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:36.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:36.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:36.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:37.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:37.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:37.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:37.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:38.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:38.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:38.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:38.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:39.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:39.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:39.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:39.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:40.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:40.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:40.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:40.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:41.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:41.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:41.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:41.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:42.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:42.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:42.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:42.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:43.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:43.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:43.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:43.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:44.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:44.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:44.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:44.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:45.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:45.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:45.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:45.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:46.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:46.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:46.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:46.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:47.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:47.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:47.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:47.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:48.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:48.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:48.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:48.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:49.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:49.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:49.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:49.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:50.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:50.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:50.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:50.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:51.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:51.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:51.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:51.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:52.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:52.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:52.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:52.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:53.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:53.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:53.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:53.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:54.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:54.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:54.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:54.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:55.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:55.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:55.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:55.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:56.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:56.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:56.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:56.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:57.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:57.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:57.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:57.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:58.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:58.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:58.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:58.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:59.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:41:59.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:41:59.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:41:59.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:00.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:00.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:00.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:00.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:01.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:01.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:01.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:01.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:02.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:02.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:02.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:02.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:03.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:03.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:03.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:03.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:04.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:04.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:04.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:04.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:05.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:05.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:05.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:05.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:06.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:06.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:06.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:06.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:07.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:07.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:07.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:07.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:08.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:08.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:08.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:08.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:09.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:09.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:09.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:09.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:10.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:10.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:10.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:10.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:11.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:11.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:11.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:11.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:12.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:12.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:12.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:12.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:13.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:13.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:13.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:13.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:14.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:14.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:14.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:14.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:15.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:15.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:15.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:15.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:16.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:16.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:16.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:16.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:17.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:17.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:17.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:17.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:18.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:18.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:18.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:18.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:19.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:19.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:19.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:19.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:20.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:20.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:20.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:20.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:21.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:21.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:21.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:21.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:22.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:22.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:22.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:22.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:23.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:23.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:23.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:23.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:24.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:24.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:24.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:24.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:25.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:25.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:25.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:25.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:26.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:26.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:26.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:26.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:27.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:27.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:27.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:27.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:28.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:28.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:28.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:28.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:29.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:29.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:29.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:29.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:30.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:30.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:30.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:30.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:31.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:31.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:31.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:31.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:32.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:32.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:32.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:32.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:33.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:33.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:33.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:33.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:34.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:34.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:34.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:34.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:35.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:35.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:35.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:35.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:36.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:36.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:36.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:36.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:37.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:37.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:37.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:37.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:38.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:38.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:38.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:38.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:39.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:39.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:39.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:39.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:40.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:40.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:40.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:40.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:41.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:41.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:41.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:41.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:42.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:41.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:42.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:42.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:42.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:42.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:43.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:43.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:43.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:43.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:44.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:44.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:44.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:44.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:45.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:45.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:45.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:45.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:46.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:46.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:46.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:46.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:47.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:47.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:47.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:47.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:48.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:48.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:48.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:48.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:49.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:49.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:49.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:49.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:50.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:50.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:50.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:50.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:51.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:51.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:51.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:51.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:52.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:52.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:52.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:52.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:53.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:53.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:53.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:53.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:54.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:54.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:55.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:55.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:55.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:55.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:56.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:56.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:56.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:56.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:57.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:57.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:57.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:57.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:57.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:57.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:58.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:58.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:58.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:58.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:59.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:42:59.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:42:59.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:42:59.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:00.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:00.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:00.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:00.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:01.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:01.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:01.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:01.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:02.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:02.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:02.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:02.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:03.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:03.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:03.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:03.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:04.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:04.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:04.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:04.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:05.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:05.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:05.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:05.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:06.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:06.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:06.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:06.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:07.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:07.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:07.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:07.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:08.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:08.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:08.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:08.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:09.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:09.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:09.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:09.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:10.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:10.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:10.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:10.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:11.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:11.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:11.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:11.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:12.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:12.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:12.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:12.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:13.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:13.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:13.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:13.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:14.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:14.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:14.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:14.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:15.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:15.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:15.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:15.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:16.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:16.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:16.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:16.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:17.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:17.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:17.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:17.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:18.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:18.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:18.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:18.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:19.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:19.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:19.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:19.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:20.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:20.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:20.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:20.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:21.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:21.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:21.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:21.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:22.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:22.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:22.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:22.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:23.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:23.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:23.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:23.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:24.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:24.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:24.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:24.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:25.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:25.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:25.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:25.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:26.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:26.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:27.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:26.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:27.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:27.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:27.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:27.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:28.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:28.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:29.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:29.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:29.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:29.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:30.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:30.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:30.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:30.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:31.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:31.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:31.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:31.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:32.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:32.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:32.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:32.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:33.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:33.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:33.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:33.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:34.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:34.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:34.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:34.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:35.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:35.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:35.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:35.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:36.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:36.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:36.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:36.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:37.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:37.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:37.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:37.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:38.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:38.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:38.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:38.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:39.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:39.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:39.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:39.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:40.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:40.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:40.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:40.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:40.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:40.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:41.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:41.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:41.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:41.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:42.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:42.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:42.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:42.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:43.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:43.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:43.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:43.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:44.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:44.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:44.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:44.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:45.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:45.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:45.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:45.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:46.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:46.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:46.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:46.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:47.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:47.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:47.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:47.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:48.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:48.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:48.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:48.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:49.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:49.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:50.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:50.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:50.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:50.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:50.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:50.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:51.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:51.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:51.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:51.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:52.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:52.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:52.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:52.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:53.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:53.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:53.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:53.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:54.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:54.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:55.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:55.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:55.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:55.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:55.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:55.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:56.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:56.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:56.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:56.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:57.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:57.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:57.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:57.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:58.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:58.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:58.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:58.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:59.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:43:59.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:43:59.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:43:59.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:00.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:00.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:00.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:00.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:01.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:01.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:01.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:01.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:02.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:02.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:02.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:02.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:03.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:03.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:03.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:03.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:04.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:04.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:04.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:04.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:05.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:05.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:05.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:05.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:06.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:06.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:06.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:06.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:07.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:07.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:07.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:07.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:08.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:08.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:08.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:08.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:09.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:09.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:09.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:09.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:10.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:10.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:10.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:10.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:11.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:11.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:11.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:11.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:12.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:12.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:12.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:12.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:13.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:13.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:13.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:13.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:14.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:14.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:14.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:14.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:15.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:15.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:15.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:15.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:16.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:16.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:16.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:16.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:17.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:17.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:17.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:17.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:18.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:18.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:18.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:18.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:19.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:19.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:19.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:19.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:20.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:20.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:20.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:20.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:21.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:21.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:21.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:21.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:22.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:22.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:22.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:22.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:23.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:23.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:23.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:23.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:24.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:24.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:24.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:24.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:25.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:25.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:25.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:25.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:26.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:26.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:26.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:26.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:27.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:27.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:27.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:27.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:28.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:28.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:28.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:28.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:29.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:29.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:29.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:29.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:30.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:30.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:30.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:30.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:31.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:31.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:31.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:31.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:32.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:32.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:32.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:32.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:33.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:33.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:33.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:33.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:34.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:34.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:34.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:34.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:35.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:35.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:35.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:35.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:36.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:36.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:36.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:36.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:37.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:37.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:37.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:37.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:38.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:38.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:38.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:38.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:39.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:39.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:39.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:39.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:40.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:40.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:41.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:40.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:41.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:41.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:41.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:41.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:42.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:42.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:42.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:42.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:43.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:43.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:43.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:43.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:44.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:44.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:44.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:44.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:45.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:45.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:45.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:45.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:46.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:46.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:46.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:46.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:47.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:47.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:48.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:48.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:48.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:48.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:49.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:48.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:49.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:49.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:50.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:50.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:50.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:50.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:51.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:51.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:51.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:51.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:52.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:52.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:52.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:52.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:53.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:53.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:53.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:53.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:54.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:54.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:54.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:54.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:55.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:55.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:55.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:55.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:56.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:56.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:56.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:56.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:57.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:57.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:57.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:57.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:58.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:58.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:58.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:58.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:59.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:44:59.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:44:59.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:44:59.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:00.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:00.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:00.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:00.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:01.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:01.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:01.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:01.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:02.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:02.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:02.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:02.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:03.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:03.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:03.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:03.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:04.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:04.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:04.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:04.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:05.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:05.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:05.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:05.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:06.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:06.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:06.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:06.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:07.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:06.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:07.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:07.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:07.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:07.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:08.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:08.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:08.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:08.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:09.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:09.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:10.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:10.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:10.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:10.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:11.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:11.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:11.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:11.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:12.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:12.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:12.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:12.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:13.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:13.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:13.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:13.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:14.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:14.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:14.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:14.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:15.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:15.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:15.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:15.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:16.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:16.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:16.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:16.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:17.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:17.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:17.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:17.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:18.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:18.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:18.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:18.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:19.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:19.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:19.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:19.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:20.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:20.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:20.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:20.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:21.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:21.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:21.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:21.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:22.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:22.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:22.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:22.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:23.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:23.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:23.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:23.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:24.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:24.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:24.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:24.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:25.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:25.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:25.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:25.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:26.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:26.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:26.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:26.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:27.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:27.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:27.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:27.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:28.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:28.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:28.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:28.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:29.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:28.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:29.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:29.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:30.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:30.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:30.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:30.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:30.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:30.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:31.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:31.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:31.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:31.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:32.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:32.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:32.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:32.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:33.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:33.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:33.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:33.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:34.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:34.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:34.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:34.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:35.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:35.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:36.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:35.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:36.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:36.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:36.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:36.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:37.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:37.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:37.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:37.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:38.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:38.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:38.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:38.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:39.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:39.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:39.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:39.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:40.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:40.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:40.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:40.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:41.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:41.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:41.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:41.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:42.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:42.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:42.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:42.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:43.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:43.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:43.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:43.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:44.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:44.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:44.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:44.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:45.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:45.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:45.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:45.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:46.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:46.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:46.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:46.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:47.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:47.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:47.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:47.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:48.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:48.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:48.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:48.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:49.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:49.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:49.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:49.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:50.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:50.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:50.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:50.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:51.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:51.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:51.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:51.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:52.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:52.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:52.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:52.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:53.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:53.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:53.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:53.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:54.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:54.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:54.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:54.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:55.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:55.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:55.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:55.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:56.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:56.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:56.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:56.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:57.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:57.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:57.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:57.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:58.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:58.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:58.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:58.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:59.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:45:59.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:45:59.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:45:59.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:00.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:00.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:00.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:00.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:01.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:01.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:01.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:01.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:02.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:02.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:02.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:02.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:03.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:03.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:03.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:03.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:04.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:04.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:04.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:04.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:05.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:05.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:05.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:05.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:06.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:06.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:06.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:06.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:07.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:07.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:07.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:07.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:08.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:08.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:08.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:08.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:09.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:09.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:09.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:09.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:10.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:10.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:10.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:10.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:11.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:11.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:11.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:11.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:12.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:12.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:12.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:12.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:13.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:13.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:13.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:13.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:14.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:14.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:14.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:14.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:15.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:15.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:15.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:15.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:16.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:16.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:16.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:16.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:17.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:17.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:17.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:17.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:18.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:18.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:18.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:18.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:19.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:19.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:19.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:19.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:20.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:20.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:20.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:20.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:21.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:21.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:21.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:21.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:22.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:22.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:22.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:22.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:23.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:23.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:23.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:23.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:24.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:24.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:24.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:24.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:25.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:25.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:25.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:25.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:26.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:26.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:26.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:26.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:27.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:27.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:27.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:27.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:28.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:28.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:28.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:28.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:29.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:29.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:29.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:29.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:30.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:30.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:30.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:30.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:31.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:31.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:31.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:31.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:32.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:32.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:32.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:32.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:33.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:33.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:33.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:33.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:34.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:34.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:34.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:34.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:35.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:35.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:35.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:35.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:36.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:36.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:36.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:36.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:37.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:37.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:37.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:37.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:38.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:38.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:38.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:38.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:39.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:39.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:39.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:39.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:40.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:40.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:40.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:40.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:41.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:41.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:41.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:41.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:42.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:42.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:42.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:42.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:43.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:43.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:43.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:43.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:44.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:44.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:44.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:44.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:45.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:45.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:45.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:45.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:46.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:46.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:46.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:46.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:47.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:47.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:47.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:47.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:48.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:48.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:48.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:48.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:49.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:49.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:49.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:49.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:50.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:50.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:50.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:50.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:51.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:51.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:51.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:51.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:52.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:52.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:52.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:52.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:53.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:53.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:53.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:53.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:54.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:54.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:54.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:54.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:55.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:55.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:55.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:55.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:56.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:56.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:56.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:56.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:57.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:57.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:57.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:57.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:58.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:58.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:58.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:58.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:59.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:46:59.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:46:59.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:46:59.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:00.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:00.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:00.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:00.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:01.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:01.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:01.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:01.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:02.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:02.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:02.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:02.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:03.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:03.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:03.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:03.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:04.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:04.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:04.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:04.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:05.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:05.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:05.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:05.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:06.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:06.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:06.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:06.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:07.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:07.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:07.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:07.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:08.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:08.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:08.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:08.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:09.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:09.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:09.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:09.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:10.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:10.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:10.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:10.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:11.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:11.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:11.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:11.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:12.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:12.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:12.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:12.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:13.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:13.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:13.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:13.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:14.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:14.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:14.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:14.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:15.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:15.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:15.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:15.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:16.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:16.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:16.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:16.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:17.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:17.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:17.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:17.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:18.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:18.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:18.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:18.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:19.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:19.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:19.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:19.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:20.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:20.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:20.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:20.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:21.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:21.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:21.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:21.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:22.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:22.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:22.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:22.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:23.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:23.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:23.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:23.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:24.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:24.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:24.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:24.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:25.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:25.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:25.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:25.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:26.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:26.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:26.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:26.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:27.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:27.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:27.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:27.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:28.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:28.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:28.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:28.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:29.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:29.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:29.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:29.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:30.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:30.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:30.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:30.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:31.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:31.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:31.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:31.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:32.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:32.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:32.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:32.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:33.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:33.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:33.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:33.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:34.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:34.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:34.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:34.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:35.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:35.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:35.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:35.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:36.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:36.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:36.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:36.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:37.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:37.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:37.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:37.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:38.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:38.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:38.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:38.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:39.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:39.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:39.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:39.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:40.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:40.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:40.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:40.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:41.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:41.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:41.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:41.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:42.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:42.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:42.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:42.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:43.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:43.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:43.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:43.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:44.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:44.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:44.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:44.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:45.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:45.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:45.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:45.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:46.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:46.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:46.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:46.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:47.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:47.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:47.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:47.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:48.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:48.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:48.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:48.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:49.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:49.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:49.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:49.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:50.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:50.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:50.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:50.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:51.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:51.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:51.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:51.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:52.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:52.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:52.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:52.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:53.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:53.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:53.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:53.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:54.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:54.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:54.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:54.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:55.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:55.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:55.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:55.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:56.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:56.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:56.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:56.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:57.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:57.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:57.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:57.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:58.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:58.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:58.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:58.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:59.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:47:59.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:47:59.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:47:59.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:00.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:00.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:00.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:00.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:01.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:01.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:01.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:01.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:02.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:02.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:02.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:02.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:03.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:03.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:03.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:03.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:04.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:04.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:04.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:04.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:05.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:05.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:05.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:05.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:06.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:06.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:06.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:06.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:07.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:07.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:07.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:07.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:08.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:08.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:09.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:08.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:09.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:09.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:10.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:10.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:10.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:10.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:10.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:10.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:11.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:11.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:12.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:12.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:12.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:12.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:12.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:12.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:13.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:13.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:14.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:14.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:14.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:14.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:15.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:14.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:15.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:15.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:15.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:15.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:16.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:16.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:16.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:16.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:17.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:17.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:17.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:17.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:18.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:17.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:18.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:18.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:19.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:19.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:19.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:19.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:20.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:20.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:20.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:20.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:21.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:21.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:22.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:22.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:22.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:22.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:23.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:23.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:23.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:23.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:24.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:24.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:24.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:24.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:25.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:25.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:25.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:25.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:26.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:25.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:26.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:26.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:27.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:27.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:27.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:27.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:28.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:28.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:28.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:28.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:29.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:29.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:29.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:29.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:30.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:30.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:30.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:30.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:31.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:31.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:31.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:31.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:32.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:32.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:32.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:32.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:33.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:33.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:33.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:33.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:34.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:34.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:34.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:34.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:35.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:35.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:35.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:35.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:36.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:36.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:36.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:36.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:37.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:37.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:37.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:37.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:38.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:38.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:38.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:38.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:39.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:39.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:39.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:39.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:40.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:40.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:40.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:40.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:41.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:41.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:41.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:41.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:41.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:41.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:42.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:42.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:43.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:43.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:43.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:43.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:44.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:44.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:44.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:44.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:45.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:45.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:45.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:45.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:45.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:45.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:46.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:46.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:46.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:46.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:47.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:47.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:47.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:47.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:48.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:48.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:49.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:49.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:49.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:49.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:50.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:50.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:50.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:50.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:51.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:51.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:51.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:51.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:52.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:52.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:52.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:52.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:53.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:53.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:53.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:53.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:54.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:54.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:54.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:54.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:55.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:55.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:55.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:55.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:56.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:56.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:56.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:56.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:57.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:57.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:57.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:57.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:57.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:57.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:58.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:58.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:59.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:48:59.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:48:59.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:48:59.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:00.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:00.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:00.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:00.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:01.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:01.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:01.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:01.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:01.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:01.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:01.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:01.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:03.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:02.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:03.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:03.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:04.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:04.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:04.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:04.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:05.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:05.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:05.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:05.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:06.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:06.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:06.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:06.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:07.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:07.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:07.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:07.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:08.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:08.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:08.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:08.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:09.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:09.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:09.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:09.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:10.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:10.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:10.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:10.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:11.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:11.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:11.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:11.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:12.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:12.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:12.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:12.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:13.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:13.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:13.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:13.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:14.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:14.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:14.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:14.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:15.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:15.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:15.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:15.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:15.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:15.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:16.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:16.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:17.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:17.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:17.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:17.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:18.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:18.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:18.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:18.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:19.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:19.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:19.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:19.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:19.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:19.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:20.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:20.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:20.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:20.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:21.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:21.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:21.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:21.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:22.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:22.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:22.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:22.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:23.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:23.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:23.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:23.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:24.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:24.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:25.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:25.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:25.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:25.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:26.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:26.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:26.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:26.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:27.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:27.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:27.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:27.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:28.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:28.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:28.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:28.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:29.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:29.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:29.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:29.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:30.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:30.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:30.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:30.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:31.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:31.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:31.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:31.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:32.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:32.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:32.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:32.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:33.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:33.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:33.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:33.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:34.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:34.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:34.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:34.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:35.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:35.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:35.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:35.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:36.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:36.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:36.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:36.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:37.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:37.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:37.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:37.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:38.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:38.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:38.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:38.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:39.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:39.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:39.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:39.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:40.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:40.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:40.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:40.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:41.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:41.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:41.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:41.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:42.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:42.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:42.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:42.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:43.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:43.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:43.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:43.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:44.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:44.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:44.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:44.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:45.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:45.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:45.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:45.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:46.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:46.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:46.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:46.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:47.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:47.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:47.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:47.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:48.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:48.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:48.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:48.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:49.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:49.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:49.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:49.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:50.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:50.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:50.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:50.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:51.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:51.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:51.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:51.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:52.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:52.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:52.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:52.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:53.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:53.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:53.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:53.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:54.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:54.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:54.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:54.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:55.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:55.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:55.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:55.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:56.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:56.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:56.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:56.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:57.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:57.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:57.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:57.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:58.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:58.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:58.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:58.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:59.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:49:59.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:49:59.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:49:59.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:00.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:00.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:00.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:00.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:01.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:01.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:01.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:01.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:02.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:02.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:02.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:02.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:03.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:03.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:03.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:03.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:04.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:04.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:04.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:04.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:05.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:05.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:05.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:05.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:06.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:06.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:06.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:06.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:07.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:07.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:07.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:07.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:08.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:08.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:08.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:08.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:09.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:09.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:09.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:09.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:10.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:10.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:10.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:10.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:11.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:11.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:11.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:11.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:12.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:12.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:12.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:12.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:13.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:13.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:13.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:13.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:14.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:14.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:14.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:14.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:15.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:15.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:15.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:15.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:16.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:16.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:16.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:16.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:17.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:17.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:17.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:17.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:18.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:18.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:18.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:18.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:19.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:19.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:19.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:19.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:20.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:20.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:20.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:20.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:21.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:21.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:21.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:21.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:22.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:22.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:22.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:22.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:23.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:23.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:23.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:23.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:24.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:24.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:24.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:24.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:25.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:25.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:25.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:25.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:26.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:26.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:26.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:26.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:27.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:27.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:27.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:27.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:28.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:28.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:28.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:28.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:29.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:29.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:29.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:29.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:30.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:30.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:30.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:30.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:31.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:31.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:31.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:31.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:32.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:32.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:32.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:32.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:33.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:33.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:33.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:33.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:34.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:34.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:34.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:34.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:35.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:35.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:35.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:35.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:36.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:36.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:36.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:36.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:37.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:37.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:37.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:37.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:38.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:38.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:38.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:38.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:39.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:39.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:39.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:39.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:40.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:40.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:40.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:40.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:41.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:41.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:41.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:41.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:42.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:42.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:42.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:42.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:43.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:43.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:43.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:43.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:44.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:44.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:44.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:44.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:45.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:45.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:45.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:45.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:46.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:46.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:46.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:46.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:47.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:47.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:47.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:47.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:48.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:48.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:48.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:48.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:49.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:49.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:49.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:49.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:50.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:50.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:50.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:50.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:51.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:51.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:51.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:51.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:52.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:52.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:52.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:52.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:53.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:53.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:53.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:53.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:54.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:54.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:54.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:55.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:55.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:55.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:55.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:56.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:56.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:56.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:56.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:57.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:57.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:57.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:57.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:58.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:58.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:58.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:58.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:59.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:50:59.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:50:59.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:50:59.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:00.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:00.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:00.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:00.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:01.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:01.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:01.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:01.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:02.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:02.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:02.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:02.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:03.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:03.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:03.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:03.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:04.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:04.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:04.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:04.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:05.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:05.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:05.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:05.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:06.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:06.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:06.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:06.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:07.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:07.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:07.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:07.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:08.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:08.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:08.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:08.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:09.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:09.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:09.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:09.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:10.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:10.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:10.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:10.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:11.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:11.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:11.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:11.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:12.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:12.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:12.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:12.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:13.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:13.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:13.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:13.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:14.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:14.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:14.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:14.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:15.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:15.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:15.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:15.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:16.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:16.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:16.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:16.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:17.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:17.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:17.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:17.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:18.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:18.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:18.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:18.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:19.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:19.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:19.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:19.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:20.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:20.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:20.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:20.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:21.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:21.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:21.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:21.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:22.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:22.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:22.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:22.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:23.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:23.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:23.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:23.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:24.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:24.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:24.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:24.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:25.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:25.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:25.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:25.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:26.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:26.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:26.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:26.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:27.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:27.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:27.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:27.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:28.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:28.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:28.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:28.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:29.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:29.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:29.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:29.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:30.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:30.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:30.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:30.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:31.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:31.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:31.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:31.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:32.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:32.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:32.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:32.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:33.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:33.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:33.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:33.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:34.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:34.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:34.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:34.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:35.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:35.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:35.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:35.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:36.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:36.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:36.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:36.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:37.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:37.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:37.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:37.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:38.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:38.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:38.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:38.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:39.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:39.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:39.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:39.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:40.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:40.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:40.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:40.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:41.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:41.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:41.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:41.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:42.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:42.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:42.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:42.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:43.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:43.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:43.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:43.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:44.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:44.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:44.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:44.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:45.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:45.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:45.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:45.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:46.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:46.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:47.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:47.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:47.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:47.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:48.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:48.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:48.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:48.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:49.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:49.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:49.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:49.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:50.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:50.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:50.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:50.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:51.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:51.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:51.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:51.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:52.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:52.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:52.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:52.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:53.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:53.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:53.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:53.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:54.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:54.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:54.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:54.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:55.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:55.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:55.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:55.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:56.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:56.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:56.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:56.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:57.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:57.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:57.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:57.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:58.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:58.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:58.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:58.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:59.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:51:59.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:51:59.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:51:59.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:00.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:00.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:00.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:00.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:01.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:01.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:01.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:01.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:02.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:02.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:02.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:02.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:03.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:03.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:03.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:03.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:04.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:04.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:04.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:04.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:05.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:05.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:05.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:05.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:06.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:06.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:06.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:06.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:07.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:07.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:07.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:07.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:08.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:08.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:08.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:08.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:09.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:09.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:09.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:09.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:10.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:10.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:10.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:10.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:11.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:11.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:11.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:11.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:12.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:12.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:12.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:12.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:13.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:13.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:13.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:13.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:14.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:14.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:14.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:14.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:15.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:15.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:15.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:15.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:16.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:16.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:16.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:16.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:17.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:17.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:17.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:17.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:18.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:18.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:18.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:18.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:19.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:19.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:19.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:19.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:20.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:20.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:20.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:20.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:21.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:21.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:21.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:21.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:22.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:22.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:22.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:22.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:23.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:23.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:23.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:23.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:24.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:24.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:24.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:24.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:25.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:25.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:25.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:25.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:26.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:26.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:26.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:26.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:27.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:27.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:27.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:27.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:28.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:28.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:28.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:28.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:29.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:29.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:29.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:29.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:30.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:30.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:30.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:30.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:31.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:31.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:31.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:31.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:32.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:32.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:32.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:32.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:33.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:33.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:33.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:33.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:34.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:34.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:34.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:34.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:35.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:35.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:35.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:35.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:36.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:36.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:36.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:36.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:37.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:37.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:37.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:37.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:38.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:38.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:38.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:38.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:39.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:39.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:39.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:39.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:40.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:40.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:40.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:40.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:41.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:41.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:41.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:41.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:42.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:42.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:42.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:42.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:43.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:43.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:43.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:43.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:44.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:44.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:44.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:44.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:45.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:45.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:45.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:45.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:46.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:46.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:46.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:46.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:47.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:47.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:47.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:47.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:48.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:48.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:48.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:48.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:49.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:49.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:49.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:49.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:50.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:50.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:50.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:50.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:51.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:51.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:51.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:51.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:52.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:52.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:52.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:52.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:53.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:53.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:53.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:53.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:54.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:54.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:54.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:55.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:55.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:55.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:55.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:56.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:56.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:56.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:56.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:57.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:57.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:57.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:57.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:58.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:58.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:58.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:58.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:59.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:52:59.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:52:59.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:52:59.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:00.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:00.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:00.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:00.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:01.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:01.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:01.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:01.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:02.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:02.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:02.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:02.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:03.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:03.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:03.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:03.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:04.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:04.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:04.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:04.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:05.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:05.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:05.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:05.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:06.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:06.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:06.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:06.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:07.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:07.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:07.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:07.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:08.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:08.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:08.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:08.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:09.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:09.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:09.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:09.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:10.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:10.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:10.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:10.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:11.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:11.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:11.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:11.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:12.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:12.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:12.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:12.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:13.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:13.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:13.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:13.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:14.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:14.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:14.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:14.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:15.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:15.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:15.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:15.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:16.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:16.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:16.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:16.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:17.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:17.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:17.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:17.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:18.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:18.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:18.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:18.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:19.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:19.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:19.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:19.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:20.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:20.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:20.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:20.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:21.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:21.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:21.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:21.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:22.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:22.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:22.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:22.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:23.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:22.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:23.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:23.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:23.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:23.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:24.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:24.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:24.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:24.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:25.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:25.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:26.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:26.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:26.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:26.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:26.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:26.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:27.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:27.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:28.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:28.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:28.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:28.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:28.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:28.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:29.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:29.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:29.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:29.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:30.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:30.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:31.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:31.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:31.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:31.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:31.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:31.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:32.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:32.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:33.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:33.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:33.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:33.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:33.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:33.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:34.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:34.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:35.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:35.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:35.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:35.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:36.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:35.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:36.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:36.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:36.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:36.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:37.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:37.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:37.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:37.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:38.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:38.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:38.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:38.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:39.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:39.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:40.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:40.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:40.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:40.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:41.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:41.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:41.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:41.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:42.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:42.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:42.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:42.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:43.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:43.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:43.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:43.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:44.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:44.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:44.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:44.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:45.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:45.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:45.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:45.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:46.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:46.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:46.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:46.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:47.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:47.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:47.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:47.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:48.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:48.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:48.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:49.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:49.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:49.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:49.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:50.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:50.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:50.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:50.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:51.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:51.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:51.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:51.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:52.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:52.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:52.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:52.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:53.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:53.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:53.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:53.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:54.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:54.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:54.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:54.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:54.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:54.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:55.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:55.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:55.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:55.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:56.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:56.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:56.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:56.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:57.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:57.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:57.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:57.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:58.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:58.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:58.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:58.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:59.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:53:59.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:53:59.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:53:59.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:00.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:00.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:00.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:00.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:01.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:01.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:01.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:01.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:02.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:02.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:02.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:02.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:03.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:03.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:03.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:03.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:04.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:04.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:04.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:04.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:05.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:05.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:05.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:05.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:06.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:06.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:06.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:06.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:07.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:07.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:07.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:07.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:08.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:08.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:08.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:08.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:09.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:09.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:09.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:09.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:10.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:10.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:10.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:10.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:11.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:11.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:11.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:11.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:12.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:12.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:12.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:12.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:13.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:13.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:13.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:13.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:14.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:14.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:14.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:14.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:15.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:15.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:15.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:15.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:16.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:16.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:16.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:16.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:17.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:17.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:17.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:17.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:18.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:18.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:18.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:18.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:19.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:19.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:19.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:19.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:20.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:20.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:20.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:20.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:21.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:21.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:21.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:21.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:22.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:22.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:22.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:22.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:23.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:23.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:23.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:23.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:24.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:24.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:24.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:24.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:25.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:25.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:25.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:25.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:26.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:26.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:26.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:26.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:27.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:27.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:27.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:27.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:28.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:28.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:28.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:28.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:29.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:29.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:29.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:29.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:30.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:30.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:30.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:30.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:31.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:31.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:31.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:31.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:32.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:32.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:32.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:32.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:33.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:33.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:33.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:33.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:34.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:34.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:34.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:34.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:35.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:35.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:35.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:35.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:36.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:36.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:36.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:36.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:37.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:37.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:37.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:37.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:38.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:38.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:38.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:38.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:39.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:39.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:39.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:39.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:40.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:40.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:40.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:40.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:41.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:41.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:41.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:41.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:42.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:42.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:42.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:42.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:43.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:43.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:43.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:43.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:44.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:44.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:44.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:44.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:45.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:45.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:45.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:45.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:46.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:46.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:46.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:46.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:47.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:47.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:47.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:47.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:48.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:48.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:48.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:48.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:49.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:49.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:49.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:49.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:50.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:50.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:50.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:50.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:51.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:51.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:51.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:51.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:52.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:52.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:52.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:52.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:53.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:53.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:53.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:53.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:54.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:54.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:54.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:54.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:55.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:55.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:55.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:55.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:56.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:56.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:56.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:56.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:57.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:57.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:57.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:57.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:58.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:58.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:58.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:58.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:59.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:54:59.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:54:59.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:54:59.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:00.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:00.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:00.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:00.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:01.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:01.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:01.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:01.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:02.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:02.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:02.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:02.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:03.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:03.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:03.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:03.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:04.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:04.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:04.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:04.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:05.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:05.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:05.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:05.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:06.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:06.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:06.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:06.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:07.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:07.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:07.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:07.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:08.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:08.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:08.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:08.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:09.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:09.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:09.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:09.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:10.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:10.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:10.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:10.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:11.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:11.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:11.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:11.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:12.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:12.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:12.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:12.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:13.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:13.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:13.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:13.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:14.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:14.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:14.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:14.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:15.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:15.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:15.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:15.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:16.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:16.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:16.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:16.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:17.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:17.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:17.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:17.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:18.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:18.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:18.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:18.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:19.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:19.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:19.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:19.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:20.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:20.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:20.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:20.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:21.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:21.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:21.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:21.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:22.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:22.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:22.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:22.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:23.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:23.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:23.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:23.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:24.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:24.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:24.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:24.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:25.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:25.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:25.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:25.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:26.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:26.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:26.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:26.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:27.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:27.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:27.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:27.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:28.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:28.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:28.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:28.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:29.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:29.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:29.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:29.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:30.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:30.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:30.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:30.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:31.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:31.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:31.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:31.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:32.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:32.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:32.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:32.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:33.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:33.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:33.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:33.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:34.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:34.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:34.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:34.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:35.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:35.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:35.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:35.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:36.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:36.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:36.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:36.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:37.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:37.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:37.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:37.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:38.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:38.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:38.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:38.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:39.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:39.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:39.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:39.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:40.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:40.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:40.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:40.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:41.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:41.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:41.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:41.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:42.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:42.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:42.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:42.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:43.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:43.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:43.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:43.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:44.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:44.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:44.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:44.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:45.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:45.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:45.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:45.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:46.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:46.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:46.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:46.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:47.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:47.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:47.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:47.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:48.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:48.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:48.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:48.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:49.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:49.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:49.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:49.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:50.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:50.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:50.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:50.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:51.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:51.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:51.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:51.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:52.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:52.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:52.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:52.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:53.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:53.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:53.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:53.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:54.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:54.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:54.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:54.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:55.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:55.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:55.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:55.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:56.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:56.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:56.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:56.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:57.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:57.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:57.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:57.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:58.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:58.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:58.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:58.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:59.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:55:59.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:55:59.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:55:59.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:00.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:00.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:00.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:00.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:01.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:01.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:01.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:01.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:02.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:02.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:02.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:02.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:03.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:03.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:03.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:03.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:04.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:04.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:04.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:04.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:05.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:05.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:05.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:05.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:06.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:06.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:06.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:06.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:07.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:07.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:07.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:07.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:08.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:08.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:08.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:08.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:09.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:09.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:09.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:09.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:10.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:10.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:10.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:10.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:11.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:11.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:11.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:11.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:12.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:12.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:12.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:12.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:13.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:13.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:13.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:13.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:14.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:14.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:14.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:14.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:15.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:15.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:15.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:15.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:16.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:16.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:16.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:16.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:17.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:17.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:17.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:17.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:18.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:18.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:18.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:18.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:19.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:19.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:19.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:19.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:20.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:20.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:20.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:20.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:21.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:21.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:21.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:21.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:22.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:22.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:22.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:22.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:23.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:23.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:23.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:23.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:24.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:24.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:24.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:24.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:25.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:25.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:25.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:25.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:26.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:26.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:26.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:26.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:27.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:27.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:27.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:27.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:28.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:28.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:28.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:28.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:29.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:29.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:29.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:29.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:30.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:30.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:30.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:30.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:31.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:31.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:31.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:31.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:32.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:32.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:32.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:32.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:33.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:33.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:33.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:33.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:34.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:34.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:34.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:34.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:35.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:35.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:35.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:35.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:36.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:36.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:36.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:36.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:37.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:37.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:37.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:37.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:38.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:38.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:38.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:38.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:39.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:39.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:39.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:39.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:40.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:40.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:40.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:40.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:41.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:41.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:41.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:41.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:42.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:42.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:42.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:42.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:43.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:43.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:43.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:43.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:44.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:44.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:44.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:44.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:45.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:45.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:45.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:45.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:46.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:46.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:46.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:46.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:47.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:47.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:47.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:47.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:48.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:48.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:48.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:48.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:49.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:49.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:49.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:49.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:50.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:50.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:50.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:50.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:51.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:51.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:51.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:51.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:52.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:52.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:52.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:52.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:53.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:53.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:53.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:53.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:54.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:54.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:54.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:54.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:55.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:55.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:55.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:55.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:56.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:56.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:56.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:56.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:57.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:57.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:57.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:57.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:58.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:58.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:58.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:58.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:59.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:56:59.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:56:59.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:56:59.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:00.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:00.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:00.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:00.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:01.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:01.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:01.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:01.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:02.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:02.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:02.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:02.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:03.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:03.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:03.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:03.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:04.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:04.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:04.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:04.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:05.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:05.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:05.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:05.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:06.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:06.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:06.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:06.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:07.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:07.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:07.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:07.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:08.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:08.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:08.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:08.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:09.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:09.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:09.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:09.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:10.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:10.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:10.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:10.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:11.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:11.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:11.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:11.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:12.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:12.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:12.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:12.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:13.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:13.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:13.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:13.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:14.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:14.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:14.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:14.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:15.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:15.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:15.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:15.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:16.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:16.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:16.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:16.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:17.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:17.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:17.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:17.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:18.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:18.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:18.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:18.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:19.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:19.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:19.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:19.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:20.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:20.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:20.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:20.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:21.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:21.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:21.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:21.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:22.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:22.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:22.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:22.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:23.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:23.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:23.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:23.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:24.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:24.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:24.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:24.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:25.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:25.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:25.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:25.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:26.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:26.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:26.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:26.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:27.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:27.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:27.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:27.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:28.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:28.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:28.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:28.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:29.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:29.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:29.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:29.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:30.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:30.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:30.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:30.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:31.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:31.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:31.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:31.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:32.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:32.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:32.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:32.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:33.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:33.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:33.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:33.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:34.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:34.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:34.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:34.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:35.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:35.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:35.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:35.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:36.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:36.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:36.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:36.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:37.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:37.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:37.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:37.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:38.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:38.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:38.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:38.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:39.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:39.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:39.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:39.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:40.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:40.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:40.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:40.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:41.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:41.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:41.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:41.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:42.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:42.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:42.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:42.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:43.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:43.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:43.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:43.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:44.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:44.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:44.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:44.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:45.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:45.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:45.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:45.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:46.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:46.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:46.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:46.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:47.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:47.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:47.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:47.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:48.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:48.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:48.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:48.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:49.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:49.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:49.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:49.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:50.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:50.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:50.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:50.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:51.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:51.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:51.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:51.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:52.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:52.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:52.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:52.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:53.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:53.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:53.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:53.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:54.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:54.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:54.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:54.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:55.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:55.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:55.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:55.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:56.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:56.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:56.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:56.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:57.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:57.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:57.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:57.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:58.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:58.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:58.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:58.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:59.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:57:59.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:57:59.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:57:59.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:00.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:00.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:00.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:00.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:01.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:01.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:01.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:01.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:02.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:02.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:02.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:02.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:03.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:03.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:03.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:03.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:04.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:04.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:04.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:04.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:05.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:05.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:05.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:05.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:06.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:06.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:06.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:07.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:07.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:07.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:07.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:08.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:08.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:08.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:08.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:09.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:09.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:09.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:09.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:10.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:10.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:10.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:10.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:11.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:11.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:11.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:11.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:12.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:12.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:12.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:12.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:13.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:13.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:13.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:13.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:14.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:14.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:14.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:14.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:15.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:15.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:15.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:15.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:16.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:16.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:16.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:16.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:17.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:17.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:17.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:17.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:18.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:18.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:18.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:18.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:19.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:19.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:19.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:19.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:20.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:20.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:21.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:21.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:21.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:21.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:21.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:21.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:22.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:22.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:22.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:22.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:23.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:23.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:23.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:23.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:24.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:24.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:24.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:24.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:25.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:25.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:25.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:25.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:26.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:26.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:26.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:26.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:27.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:27.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:27.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:27.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:28.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:28.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:28.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:28.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:29.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:29.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:29.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:29.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:30.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:30.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:30.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:30.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:31.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:31.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:31.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:31.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:32.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:32.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:32.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:32.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:33.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:33.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:33.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:33.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:34.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:34.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:34.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:34.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:35.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:35.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:35.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:35.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:36.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:36.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:36.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:36.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:37.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:37.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:37.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:37.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:38.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:38.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:38.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:38.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:39.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:39.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:39.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:39.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:40.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:40.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:40.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:40.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:41.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:41.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:41.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:41.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:42.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:42.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:42.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:42.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:43.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:43.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:43.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:43.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:44.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:44.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:44.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:44.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:45.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:45.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:45.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:45.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:46.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:46.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:46.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:46.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:47.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:47.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:47.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:47.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:48.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:48.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:48.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:48.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:49.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:49.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:49.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:49.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:50.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:50.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:50.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:50.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:51.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:51.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:51.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:51.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:52.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:52.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:53.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:53.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:53.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:53.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:53.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:53.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:54.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:54.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:54.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:54.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:55.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:55.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:55.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:55.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:56.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:56.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:56.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:56.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:57.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:57.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:58.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:58.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:58.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:58.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:58.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:58.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:59.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:58:59.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:58:59.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:58:59.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:00.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:00.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:00.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:00.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:01.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:01.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:01.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:01.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:02.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:02.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:02.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:02.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:03.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:03.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:03.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:03.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:04.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:04.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:04.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:04.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:05.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:05.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:05.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:05.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:06.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:06.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:06.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:06.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:07.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:07.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:07.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:07.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:08.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:08.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:08.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:08.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:09.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:09.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:09.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:09.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:10.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:10.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:10.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:10.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:11.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:11.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:11.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:11.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:12.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:12.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:12.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:12.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:13.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:13.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:13.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:13.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:14.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:14.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:14.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:14.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:15.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:15.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:15.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:15.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:16.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:16.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:16.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:16.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:17.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:17.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:17.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:17.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:18.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:18.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:18.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:18.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:19.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:19.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:19.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:19.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:20.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:20.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:20.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:20.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:21.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:21.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:21.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:21.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:22.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:22.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:22.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:22.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:23.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:23.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:23.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:23.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:24.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:24.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:24.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:24.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:25.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:25.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:25.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:25.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:26.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:26.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:26.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:26.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:27.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:27.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:27.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:27.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:28.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:28.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:28.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:28.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:29.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:29.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:29.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:29.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:30.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:30.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:30.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:30.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:31.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:31.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:31.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:31.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:32.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:32.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:32.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:32.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:33.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:33.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:33.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:33.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:34.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:34.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:34.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:34.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:35.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:35.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:35.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:35.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:36.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:36.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:36.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:36.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:37.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:37.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:37.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:37.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:38.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:38.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:38.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:38.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:39.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:39.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:39.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:39.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:40.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:40.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:40.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:40.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:41.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:41.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:41.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:41.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:42.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:42.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:42.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:42.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:43.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:43.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:43.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:43.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:44.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:44.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:44.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:44.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:45.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:45.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:45.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:45.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:46.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:46.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:46.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:46.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:47.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:47.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:47.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:47.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:48.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:48.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:48.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:48.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:49.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:49.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:50.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:50.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:50.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:50.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:50.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:50.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:51.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:51.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:51.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:51.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:52.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:52.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:52.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:52.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:53.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:53.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:53.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:53.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:54.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:54.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:54.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:54.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:55.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:55.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:55.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:55.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:56.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:56.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:56.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:56.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:57.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:57.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:57.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:57.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:58.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:58.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:59.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:59.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:59.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T21:59:59.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T21:59:59.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T21:59:59.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:00.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:00.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:00.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:00.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:01.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:01.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:01.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:01.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:02.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:02.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:02.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:02.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:03.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:03.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:03.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:03.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:04.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:04.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:04.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:04.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:05.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:05.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:05.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:05.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:06.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:06.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:06.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:06.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:07.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:07.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:07.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:07.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:08.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:08.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:08.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:08.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:09.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:09.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:09.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:09.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:10.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:10.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:10.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:10.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:11.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:11.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:11.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:11.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:12.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:12.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:12.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:12.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:13.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:13.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:13.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:13.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:14.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:14.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:14.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:14.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:15.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:15.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:15.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:15.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:16.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:16.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:16.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:16.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:17.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:17.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:17.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:17.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:18.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:18.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:18.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:18.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:19.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:19.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:19.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:19.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:20.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:20.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:20.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:20.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:21.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:21.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:21.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:21.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:22.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:22.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:22.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:22.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:23.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:23.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:23.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:23.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:24.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:24.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:24.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:24.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:25.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:25.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:25.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:25.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:26.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:26.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:26.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:26.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:27.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:27.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:27.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:27.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:28.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:28.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:28.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:28.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:29.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:29.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:29.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:29.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:30.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:30.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:30.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:30.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:31.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:31.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:31.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:31.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:32.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:32.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:32.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:32.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:33.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:33.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:33.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:33.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:34.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:34.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:34.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:34.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:35.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:35.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:35.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:35.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:36.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:36.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:36.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:36.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:37.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:37.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:37.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:37.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:38.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:38.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:38.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:38.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:39.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:39.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:39.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:39.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:40.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:40.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:40.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:40.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:41.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:41.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:42.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:42.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:42.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:42.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:43.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:43.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:43.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:43.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:44.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:44.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:44.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:44.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:45.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:45.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:45.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:45.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:46.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:46.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:46.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:46.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:47.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:47.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:47.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:47.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:48.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:48.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:48.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:48.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:49.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:49.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:49.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:49.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:50.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:50.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:50.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:50.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:51.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:51.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:51.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:51.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:52.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:52.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:52.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:52.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:53.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:53.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:53.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:54.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:54.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:54.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:54.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:55.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:55.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:55.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:55.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:56.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:56.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:56.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:56.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:57.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:57.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:57.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:57.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:58.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:58.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:58.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:58.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:59.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:00:59.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:00:59.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:00:59.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:00.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:00.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:01.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:01.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:01.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:01.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:02.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:02.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:02.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:02.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:03.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:03.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:03.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:03.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:04.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:04.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:04.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:04.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:05.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:05.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:05.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:05.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:06.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:06.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:06.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:06.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:07.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:07.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:07.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:07.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:08.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:08.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:08.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:08.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:09.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:09.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:09.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:09.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:10.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:10.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:10.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:10.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:11.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:11.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:11.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:11.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:12.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:12.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:12.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:12.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:13.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:13.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:13.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:13.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:14.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:14.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:14.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:14.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:15.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:15.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:15.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:15.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:16.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:16.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:16.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:16.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:17.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:17.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:17.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:17.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:18.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:18.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:18.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:18.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:19.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:19.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:19.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:19.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:20.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:20.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:20.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:20.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:21.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:21.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:21.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:21.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:22.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:22.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:22.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:22.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:23.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:23.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:23.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:23.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:24.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:24.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:24.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:24.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:25.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:25.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:25.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:25.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:26.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:26.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:26.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:26.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:27.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:27.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:27.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:27.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:28.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:28.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:28.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:28.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:29.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:29.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:29.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:29.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:30.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:30.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:30.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:30.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:30.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:30.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:31.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:31.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:31.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:31.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:32.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:32.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:33.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:32.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:33.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:33.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:34.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:34.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:34.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:34.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:35.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:35.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:35.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:35.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:36.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:36.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:36.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:36.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:37.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:37.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:37.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:37.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:38.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:38.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:38.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:38.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:39.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:39.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:39.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:39.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:40.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:40.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:40.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:40.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:41.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:41.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:41.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:41.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:42.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:42.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:42.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:42.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:43.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:43.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:43.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:43.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:44.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:44.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:44.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:44.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:45.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:45.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:45.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:45.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:46.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:46.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:46.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:46.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:47.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:47.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:47.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:47.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:48.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:48.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:48.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:48.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:49.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:49.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:49.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:49.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:50.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:50.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:50.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:50.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:51.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:51.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:51.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:51.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:52.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:52.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:52.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:52.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:53.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:53.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:53.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:53.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:54.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:54.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:54.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:54.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:55.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:55.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:55.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:55.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:56.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:56.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:56.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:56.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:57.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:57.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:57.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:57.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:58.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:58.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:58.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:58.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:59.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:01:59.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:01:59.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:01:59.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:00.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:00.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:00.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:00.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:01.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:01.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:01.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:01.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:02.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:02.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:02.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:02.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:03.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:03.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:03.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:03.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:04.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:04.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:04.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:04.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:05.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:05.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:05.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:05.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:06.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:06.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:06.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:06.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:07.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:07.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:07.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:07.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:08.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:08.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:08.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:08.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:09.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:09.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:09.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:09.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:10.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:10.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:10.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:10.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:11.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:11.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:11.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:11.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:12.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:12.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:12.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:12.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:13.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:13.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:13.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:13.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:14.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:14.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:14.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:14.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:15.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:15.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:15.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:15.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:16.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:16.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:16.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:16.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:17.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:17.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:17.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:17.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:18.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:18.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:18.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:18.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:19.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:19.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:19.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:19.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:20.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:20.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:20.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:20.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:21.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:21.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:21.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:21.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:22.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:22.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:22.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:22.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:23.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:23.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:23.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:23.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:24.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:24.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:24.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:24.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:25.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:25.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:25.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:25.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:26.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:26.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:26.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:26.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:27.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:27.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:27.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:27.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:28.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:28.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:28.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:28.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:29.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:29.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:29.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:29.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:30.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:30.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:30.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:30.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:31.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:31.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:31.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:31.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:32.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:32.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:32.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:32.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:33.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:33.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:33.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:33.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:34.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:34.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:34.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:34.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:35.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:35.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:35.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:35.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:36.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:36.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:36.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:36.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:37.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:37.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:37.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:37.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:38.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:38.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:38.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:38.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:39.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:39.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:39.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:39.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:40.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:40.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:40.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:40.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:41.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:41.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:41.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:41.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:42.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:42.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:42.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:42.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:43.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:43.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:43.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:43.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:44.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:44.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:44.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:44.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:45.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:45.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:45.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:45.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:46.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:46.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:46.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:46.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:47.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:47.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:47.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:47.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:48.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:48.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:48.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:48.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:49.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:49.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:49.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:49.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:50.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:50.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:50.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:50.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:51.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:51.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:51.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:51.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:52.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:52.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:52.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:52.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:53.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:53.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:53.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:53.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:54.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:54.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:54.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:54.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:55.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:55.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:55.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:55.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:56.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:56.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:56.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:56.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:57.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:57.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:57.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:57.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:58.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:58.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:58.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:58.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:59.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:02:59.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:02:59.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:02:59.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:00.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:00.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:00.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:00.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:01.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:01.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:01.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:01.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:02.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:02.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:02.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:02.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:03.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:03.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:03.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:03.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:04.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:04.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:04.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:04.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:05.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:05.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:05.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:05.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:06.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:06.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:06.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:06.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:07.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:07.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:07.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:07.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:08.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:08.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:08.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:08.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:09.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:09.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:09.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:09.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:10.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:10.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:10.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:10.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:11.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:11.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:11.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:11.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:12.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:12.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:12.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:12.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:13.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:13.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:13.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:13.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:14.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:14.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:14.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:14.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:15.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:15.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:15.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:15.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:16.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:16.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:16.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:16.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:17.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:17.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:17.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:17.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:18.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:18.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:18.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:18.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:19.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:19.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:19.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:19.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:20.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:20.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:20.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:20.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:21.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:21.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:21.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:21.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:22.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:22.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:22.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:22.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:23.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:23.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:23.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:23.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:24.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:24.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:24.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:24.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:25.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:25.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:25.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:25.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:26.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:26.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:26.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:26.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:27.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:27.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:27.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:27.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:28.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:28.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:28.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:28.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:29.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:29.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:29.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:29.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:30.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:30.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:30.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:30.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:31.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:31.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:31.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:31.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:32.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:32.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:32.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:32.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:33.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:33.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:33.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:33.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:34.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:34.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:34.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:34.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:35.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:35.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:35.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:35.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:36.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:36.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:36.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:36.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:37.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:37.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:37.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:37.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:38.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:38.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:38.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:38.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:39.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:39.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:39.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:39.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:40.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:40.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:40.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:40.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:41.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:41.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:41.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:41.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:42.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:42.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:42.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:42.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:43.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:43.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:43.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:43.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:44.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:44.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:44.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:44.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:45.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:45.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:45.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:45.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:46.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:46.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:46.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:46.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:47.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:47.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:47.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:47.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:48.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:48.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:48.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:48.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:49.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:49.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:49.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:49.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:50.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:50.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:50.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:50.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:51.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:51.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:51.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:51.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:52.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:52.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:52.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:52.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:53.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:53.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:53.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:53.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:54.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:54.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:54.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:54.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:55.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:55.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:55.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:55.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:56.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:56.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:56.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:56.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:57.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:57.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:57.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:57.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:58.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:58.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:58.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:58.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:59.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:03:59.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:03:59.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:03:59.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:00.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:00.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:00.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:00.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:01.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:01.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:01.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:01.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:02.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:02.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:02.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:02.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:03.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:03.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:03.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:03.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:04.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:04.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:04.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:04.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:05.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:05.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:05.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:05.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:06.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:06.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:06.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:06.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:07.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:07.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:07.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:07.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:08.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:08.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:08.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:08.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:09.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:09.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:09.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:09.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:10.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:10.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:10.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:10.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:11.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:11.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:11.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:11.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:12.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:12.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:12.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:12.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:13.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:13.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:13.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:13.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:14.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:14.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:14.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:14.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:15.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:15.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:15.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:15.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:16.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:16.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:16.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:16.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:17.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:17.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:17.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:17.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:18.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:18.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:18.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:18.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:19.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:19.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:19.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:19.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:20.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:20.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:20.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:20.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:21.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:21.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:21.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:21.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:22.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:22.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:22.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:22.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:23.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:23.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:23.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:23.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:24.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:24.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:24.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:24.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:25.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:25.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:25.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:25.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:26.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:26.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:26.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:26.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:27.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:27.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:27.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:27.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:28.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:28.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:28.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:28.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:29.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:29.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:29.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:29.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:30.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:30.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:30.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:30.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:31.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:31.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:31.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:31.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:32.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:32.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:32.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:32.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:33.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:33.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:33.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:33.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:34.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:34.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:34.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:34.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:35.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:35.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:35.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:35.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:36.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:36.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:36.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:36.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:37.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:37.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:37.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:37.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:38.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:38.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:38.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:38.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:39.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:39.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:39.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:39.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:40.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:40.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:40.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:40.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:41.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:41.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:41.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:41.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:42.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:42.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:42.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:42.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:43.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:43.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:43.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:43.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:44.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:44.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:44.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:44.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:45.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:45.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:45.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:45.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:46.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:46.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:46.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:46.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:47.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:47.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:47.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:47.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:48.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:48.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:48.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:48.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:49.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:49.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:49.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:49.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:50.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:50.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:50.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:50.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:51.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:51.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:51.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:51.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:52.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:52.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:52.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:52.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:53.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:53.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:53.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:53.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:54.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:54.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:54.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:54.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:55.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:55.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:55.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:55.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:56.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:56.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:56.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:56.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:57.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:57.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:57.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:57.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:58.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:58.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:58.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:58.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:59.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:04:59.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:04:59.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:04:59.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:00.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:00.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:00.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:00.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:01.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:01.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:01.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:01.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:02.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:02.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:02.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:02.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:03.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:03.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:03.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:03.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:04.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:04.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:04.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:04.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:05.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:05.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:05.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:05.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:06.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:06.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:06.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:06.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:07.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:07.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:07.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:07.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:08.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:08.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:08.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:08.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:09.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:09.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:09.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:09.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:10.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:10.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:10.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:10.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:11.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:11.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:11.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:11.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:12.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:12.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:12.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:12.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:13.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:13.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:13.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:14.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:14.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:14.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:14.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:15.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:15.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:15.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:15.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:16.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:16.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:16.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:16.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:17.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:17.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:17.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:17.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:18.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:18.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:18.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:19.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:19.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:19.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:19.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:20.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:20.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:20.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:20.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:21.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:21.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:21.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:21.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:22.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:22.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:22.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:22.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:23.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:23.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:23.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:23.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:24.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:24.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:24.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:24.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:25.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:25.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:25.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:25.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:26.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:26.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:26.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:26.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:27.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:27.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:27.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:27.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:28.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:28.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:28.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:28.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:29.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:29.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:29.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:29.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:30.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:30.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:30.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:30.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:31.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:31.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:31.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:31.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:32.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:32.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:32.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:32.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:33.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:33.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:33.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:33.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:34.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:34.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:34.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:34.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:35.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:35.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:35.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:35.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:36.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:36.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:36.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:36.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:37.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:37.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:37.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:37.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:38.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:38.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:38.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:38.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:39.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:39.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:39.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:39.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:40.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:40.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:40.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:40.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:41.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:41.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:41.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:41.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:42.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:42.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:42.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:42.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:43.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:43.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:43.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:43.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:44.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:44.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:44.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:44.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:45.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:45.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:45.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:45.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:46.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:46.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:46.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:46.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:47.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:47.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:47.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:47.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:48.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:48.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:48.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:48.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:49.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:49.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:49.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:49.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:50.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:50.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:50.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:50.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:51.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:51.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:51.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:51.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:52.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:52.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:52.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:52.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:53.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:53.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:53.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:53.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:54.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:54.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:54.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:54.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:55.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:55.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:55.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:55.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:56.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:56.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:56.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:56.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:57.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:57.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:57.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:57.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:58.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:58.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:58.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:58.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:59.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:05:59.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:05:59.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:05:59.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:00.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:00.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:00.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:00.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:01.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:01.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:01.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:01.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:02.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:02.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:02.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:02.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:03.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:03.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:03.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:03.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:04.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:04.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:04.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:04.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:05.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:05.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:05.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:05.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:06.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:06.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:06.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:06.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:07.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:07.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:07.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:07.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:08.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:08.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:08.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:08.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:09.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:09.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:09.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:09.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:10.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:10.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:10.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:10.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:11.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:11.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:11.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:11.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:11.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:11.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:12.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:12.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:13.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:13.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:13.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:13.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:14.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:14.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:14.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:14.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:15.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:15.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:15.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:15.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:16.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:16.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:16.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:16.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:17.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:17.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:17.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:17.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:18.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:18.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:18.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:18.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:19.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:19.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:19.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:19.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:20.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:20.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:20.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:20.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:21.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:21.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:21.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:21.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:21.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:21.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:22.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:22.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:22.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:22.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:23.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:23.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:23.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:23.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:24.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:24.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:24.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:24.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:25.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:25.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:25.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:25.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:26.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:26.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:27.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:27.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:27.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:27.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:28.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:28.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:28.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:28.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:29.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:29.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:29.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:29.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:30.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:30.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:30.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:30.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:31.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:31.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:31.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:31.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:32.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:32.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:32.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:32.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:33.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:33.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:33.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:33.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:34.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:34.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:34.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:34.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:35.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:35.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:35.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:35.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:35.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:35.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:36.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:36.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:37.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:36.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:37.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:37.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:37.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:37.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:38.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:38.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:39.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:39.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:39.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:39.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:39.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:39.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:40.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:40.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:40.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:40.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:41.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:41.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:41.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:41.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:42.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:42.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:42.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:42.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:43.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:43.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:43.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:43.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:44.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:44.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:44.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:44.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:45.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:45.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:45.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:45.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:46.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:46.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:46.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:46.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:47.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:47.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:47.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:47.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:48.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:48.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:48.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:48.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:49.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:49.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:50.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:50.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:50.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:50.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:51.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:51.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:51.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:51.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:52.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:52.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:52.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:52.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:53.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:53.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:53.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:53.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:54.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:54.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:54.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:54.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:55.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:55.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:55.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:55.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:56.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:56.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:56.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:56.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:57.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:57.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:57.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:57.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:58.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:58.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:58.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:58.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:59.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:06:59.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:06:59.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:06:59.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:00.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:00.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:00.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:00.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:01.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:01.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:01.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:01.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:02.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:02.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:02.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:02.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:03.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:03.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:03.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:03.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:04.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:04.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:04.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:04.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:05.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:05.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:05.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:05.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:06.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:06.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:06.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:06.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:07.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:07.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:07.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:07.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:08.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:08.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:08.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:08.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:09.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:09.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:09.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:09.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:10.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:10.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:11.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:10.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:11.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:11.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:12.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:12.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:12.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:12.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:13.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:13.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:13.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:13.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:13.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:13.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:14.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:14.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:14.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:14.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:15.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:15.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:15.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:15.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:16.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:16.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:16.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:16.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:17.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:17.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:17.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:17.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:18.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:18.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:18.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:18.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:19.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:19.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:20.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:20.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:20.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:20.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:21.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:21.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:21.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:21.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:21.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:21.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:22.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:22.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:23.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:23.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:23.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:23.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:24.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:24.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:24.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:24.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:25.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:25.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:25.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:25.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:26.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:26.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:26.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:26.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:27.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:27.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:27.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:27.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:28.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:28.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:28.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:28.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:29.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:29.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:29.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:29.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:30.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:30.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:30.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:30.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:31.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:31.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:31.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:31.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:32.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:32.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:32.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:32.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:33.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:33.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:33.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:33.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:34.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:34.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:34.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:34.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:35.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:35.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:35.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:35.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:36.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:36.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:36.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:36.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:37.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:37.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:37.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:37.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:38.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:38.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:38.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:38.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:39.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:39.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:39.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:39.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:40.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:40.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:40.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:40.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:40.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:40.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:41.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:41.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:41.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:41.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:42.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:42.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:42.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:42.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:43.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:43.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:43.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:43.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:44.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:44.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:44.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:44.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:45.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:45.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:45.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:45.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:46.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:46.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:46.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:46.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:47.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:47.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:47.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:47.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:48.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:48.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:48.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:48.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:49.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:49.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:50.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:50.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:50.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:50.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:50.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:50.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:51.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:51.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:51.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:51.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:52.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:52.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:52.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:52.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:53.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:53.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:54.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:54.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:54.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:54.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:55.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:55.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:55.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:55.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:56.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:56.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:56.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:56.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:57.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:57.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:57.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:57.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:58.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:58.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:58.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:58.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:59.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:07:59.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:07:59.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:07:59.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:00.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:00.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:00.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:00.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:01.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:01.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:01.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:01.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:02.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:02.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:02.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:02.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:03.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:03.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:03.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:03.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:04.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:04.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:04.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:04.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:05.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:05.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:05.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:05.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:06.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:06.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:06.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:06.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:07.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:07.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:07.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:07.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:08.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:08.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:08.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:08.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:09.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:09.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:09.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:09.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:10.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:10.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:10.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:10.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:11.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:11.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:11.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:11.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:12.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:12.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:12.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:12.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:13.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:13.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:13.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:13.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:14.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:14.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:14.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:14.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:15.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:15.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:15.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:15.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:16.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:16.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:16.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:16.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:17.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:17.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:17.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:17.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:18.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:18.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:18.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:18.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:19.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:19.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:19.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:19.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:20.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:20.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:20.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:20.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:21.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:21.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:21.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:21.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:22.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:22.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:22.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:22.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:23.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:23.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:23.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:23.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:24.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:24.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:24.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:24.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:25.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:25.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:25.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:25.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:26.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:26.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:26.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:26.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:27.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:27.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:27.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:27.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:28.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:28.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:28.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:28.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:29.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:29.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:29.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:29.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:30.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:30.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:30.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:30.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:31.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:31.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:31.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:31.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:32.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:32.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:32.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:32.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:33.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:33.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:33.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:33.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:34.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:34.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:34.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:34.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:35.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:35.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:35.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:35.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:36.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:36.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:36.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:36.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:37.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:37.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:37.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:37.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:38.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:38.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:38.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:38.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:39.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:39.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:39.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:39.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:40.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:40.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:40.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:40.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:41.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:41.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:41.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:41.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:42.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:42.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:42.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:42.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:43.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:43.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:43.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:43.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:44.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:44.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:44.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:44.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:45.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:45.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:45.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:45.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:46.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:46.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:46.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:46.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:47.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:47.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:47.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:47.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:48.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:48.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:48.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:48.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:49.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:49.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:49.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:49.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:50.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:50.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:50.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:50.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:51.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:51.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:51.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:51.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:52.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:52.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:52.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:52.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:53.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:53.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:53.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:53.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:54.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:54.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:54.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:54.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:55.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:55.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:55.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:55.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:56.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:56.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:56.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:56.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:57.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:57.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:57.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:57.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:58.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:58.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:58.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:58.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:59.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:08:59.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:08:59.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:08:59.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:00.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:00.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:00.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:00.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:01.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:01.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:01.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:01.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:02.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:02.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:02.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:02.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:03.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:03.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:03.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:03.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:04.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:04.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:04.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:04.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:05.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:05.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:05.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:05.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:06.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:06.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:06.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:06.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:07.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:07.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:07.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:07.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:08.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:08.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:08.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:08.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:09.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:09.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:09.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:09.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:10.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:10.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:10.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:10.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:11.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:11.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:11.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:11.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:12.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:12.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:12.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:12.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:13.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:13.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:13.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:13.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:14.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:14.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:14.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:14.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:15.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:15.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:15.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:15.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:16.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:16.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:16.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:16.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:17.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:17.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:17.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:17.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:18.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:18.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:18.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:18.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:19.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:19.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:19.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:19.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:20.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:20.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:20.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:20.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:21.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:21.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:21.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:21.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:22.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:22.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:22.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:22.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:23.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:23.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:23.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:23.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:24.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:24.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:24.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:24.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:25.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:25.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:25.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:25.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:26.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:26.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:26.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:26.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:27.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:27.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:27.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:27.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:28.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:28.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:28.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:28.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:29.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:29.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:29.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:29.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:30.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:30.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:30.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:30.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:31.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:31.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:31.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:31.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:32.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:32.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:32.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:32.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:33.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:33.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:33.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:33.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:34.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:34.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:34.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:34.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:35.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:35.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:35.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:35.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:36.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:36.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:36.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:36.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:37.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:37.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:37.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:37.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:38.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:38.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:38.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:38.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:39.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:39.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:39.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:39.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:40.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:40.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:40.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:40.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:41.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:41.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:41.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:41.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:42.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:42.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:42.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:42.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:43.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:43.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:43.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:43.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:44.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:44.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:44.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:44.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:45.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:45.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:45.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:45.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:46.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:46.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:46.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:46.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:47.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:47.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:47.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:47.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:48.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:48.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:48.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:48.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:49.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:49.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:49.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:49.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:50.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:50.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:50.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:50.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:51.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:51.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:51.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:51.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:52.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:52.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:52.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:52.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:53.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:53.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:53.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:53.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:54.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:54.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:54.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:54.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:55.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:55.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:55.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:55.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:56.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:56.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:56.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:56.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:57.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:57.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:57.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:57.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:58.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:58.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:58.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:58.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:59.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:09:59.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:09:59.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:09:59.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:00.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:00.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:00.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:00.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:01.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:01.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:01.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:01.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:02.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:02.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:02.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:02.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:03.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:03.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:03.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:03.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:04.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:04.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:04.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:04.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:05.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:05.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:05.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:05.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:06.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:06.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:06.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:06.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:07.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:07.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:07.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:07.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:08.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:08.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:08.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:08.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:09.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:09.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:09.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:09.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:10.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:10.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:10.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:10.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:11.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:11.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:11.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:11.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:12.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:12.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:12.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:12.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:13.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:13.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:13.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:13.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:14.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:14.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:14.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:14.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:15.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:15.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:15.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:15.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:16.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:16.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:16.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:16.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:17.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:17.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:17.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:17.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:18.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:18.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:18.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:18.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:19.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:19.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:19.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:19.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:20.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:20.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:20.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:20.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:21.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:21.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:22.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:22.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:22.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:22.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:22.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:22.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:23.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:23.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:24.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:23.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:24.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:24.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:24.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:24.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:25.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:25.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:25.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:25.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:26.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:26.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:26.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:26.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:27.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:27.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:27.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:27.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:28.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:28.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:28.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:28.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:29.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:29.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:29.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:29.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:30.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:30.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:30.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:30.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:31.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:31.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:31.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:31.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:32.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:32.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:32.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:32.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:33.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:33.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:33.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:33.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:34.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:34.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:34.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:34.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:35.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:35.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:35.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:35.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:36.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:36.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:36.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:36.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:37.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:37.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:37.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:37.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:38.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:38.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:38.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:38.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:39.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:39.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:39.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:39.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:40.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:40.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:41.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:41.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:41.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:41.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:42.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:42.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:42.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:42.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:43.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:43.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:43.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:43.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:44.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:44.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:44.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:44.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:45.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:45.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:45.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:45.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:46.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:46.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:46.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:46.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:47.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:47.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:47.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:47.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:48.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:48.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:48.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:48.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:49.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:49.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:49.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:49.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:50.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:50.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:50.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:50.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:51.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:51.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:51.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:51.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:51.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:51.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:52.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:52.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:53.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:53.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:53.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:53.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:54.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:54.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:54.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:54.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:55.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:55.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:55.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:55.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:56.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:56.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:56.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:56.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:57.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:57.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:57.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:57.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:58.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:58.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:58.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:58.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:59.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:10:59.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:10:59.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:10:59.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:00.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:00.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:00.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:00.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:01.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:01.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:01.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:01.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:02.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:02.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:02.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:02.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:03.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:03.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:03.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:03.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:04.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:04.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:04.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:04.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:05.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:05.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:05.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:05.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:06.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:06.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:06.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:06.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:07.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:07.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:07.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:07.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:08.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:08.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:08.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:08.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:09.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:09.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:09.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:09.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:10.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:10.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:10.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:10.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:11.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:11.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:11.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:11.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:12.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:12.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:12.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:12.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:13.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:13.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:13.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:13.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:14.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:14.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:14.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:14.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:15.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:15.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:15.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:15.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:16.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:16.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:16.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:16.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:17.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:17.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:17.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:17.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:18.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:18.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:18.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:18.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:19.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:19.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:19.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:19.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:20.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:20.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:20.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:20.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:21.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:21.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:21.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:21.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:22.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:22.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:22.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:22.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:23.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:23.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:23.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:23.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:24.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:24.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:24.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:24.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:25.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:25.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:25.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:25.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:26.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:26.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:26.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:26.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:27.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:27.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:27.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:27.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:28.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:28.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:28.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:28.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:29.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:29.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:29.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:29.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:30.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:30.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:30.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:30.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:31.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:31.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:31.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:31.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:32.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:32.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:32.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:32.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:33.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:33.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:33.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:33.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:34.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:34.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:34.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:34.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:35.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:35.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:36.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:36.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:36.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:36.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:36.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:36.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:37.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:37.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:38.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:38.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:38.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:38.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:39.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:39.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:39.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:39.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:39.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:39.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:40.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:40.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:41.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:41.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:41.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:41.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:42.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:42.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:42.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:42.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:43.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:43.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:43.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:43.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:44.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:44.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:44.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:44.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:45.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:45.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:45.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:45.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:46.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:46.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:46.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:46.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:47.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:47.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:47.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:47.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:48.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:48.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:48.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:48.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:49.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:49.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:49.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:49.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:50.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:50.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:50.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:50.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:51.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:51.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:51.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:51.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:52.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:52.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:52.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:52.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:53.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:53.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:53.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:53.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:54.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:54.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:54.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:54.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:55.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:55.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:55.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:55.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:56.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:56.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:56.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:56.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:57.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:57.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:57.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:57.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:58.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:58.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:58.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:58.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:59.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:11:59.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:11:59.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:11:59.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:00.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:00.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:00.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:00.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:01.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:01.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:01.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:01.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:02.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:02.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:02.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:02.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:03.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:03.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:03.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:03.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:04.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:04.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:04.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:04.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:05.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:05.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:05.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:05.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:06.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:06.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:06.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:06.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:07.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:07.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:07.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:07.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:08.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:08.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:08.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:08.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:09.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:09.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:09.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:09.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:10.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:10.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:10.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:10.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:11.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:11.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:11.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:11.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:12.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:12.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:12.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:12.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:13.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:13.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:13.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:13.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:14.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:14.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:14.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:14.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:15.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:15.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:15.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:15.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:16.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:16.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:16.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:16.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:17.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:17.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:17.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:17.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:18.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:18.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:18.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:18.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:19.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:19.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:19.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:19.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:20.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:20.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:20.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:20.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:21.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:21.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:21.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:21.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:22.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:22.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:22.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:22.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:23.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:23.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:23.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:23.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:24.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:24.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:24.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:24.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:25.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:25.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:25.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:25.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:26.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:26.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:26.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:26.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:27.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:27.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:27.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:27.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:28.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:28.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:28.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:28.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:29.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:29.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:29.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:29.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:30.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:30.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:30.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:30.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:31.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:31.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:31.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:31.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:32.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:32.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:32.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:32.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:33.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:33.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:33.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:33.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:34.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:34.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:34.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:34.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:35.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:35.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:35.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:35.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:36.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:36.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:36.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:36.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:37.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:37.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:37.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:37.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:38.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:38.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:38.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:38.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:39.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:39.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:39.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:39.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:40.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:40.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:40.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:40.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:41.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:41.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:41.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:41.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:42.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:42.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:42.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:42.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:43.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:43.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:43.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:43.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:44.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:44.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:44.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:44.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:45.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:45.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:45.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:45.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:46.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:46.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:46.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:46.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:47.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:47.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:47.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:47.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:48.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:48.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:48.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:48.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:49.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:49.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:49.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:49.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:50.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:50.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:50.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:50.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:51.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:51.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:51.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:51.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:52.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:52.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:52.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:52.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:53.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:53.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:53.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:53.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:54.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:54.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:54.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:54.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:55.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:55.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:55.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:55.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:56.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:56.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:56.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:57.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:57.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:57.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:57.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:58.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:58.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:58.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:58.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:59.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:12:59.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:12:59.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:12:59.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:00.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:00.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:00.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:00.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:01.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:01.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:01.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:01.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:02.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:02.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:02.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:02.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:03.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:03.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:03.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:03.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:04.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:04.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:04.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:04.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:05.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:05.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:05.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:05.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:06.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:06.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:06.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:06.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:07.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:07.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:07.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:07.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:08.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:08.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:09.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:09.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:09.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:09.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:10.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:10.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:10.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:10.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:11.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:11.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:11.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:11.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:12.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:12.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:12.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:12.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:13.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:13.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:13.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:13.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:14.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:14.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:14.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:14.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:15.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:15.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:15.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:15.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:16.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:16.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:16.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:16.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:17.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:17.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:17.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:17.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:18.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:18.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:18.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:18.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:19.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:19.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:19.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:19.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:20.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:20.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:20.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:20.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:21.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:21.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:21.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:21.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:22.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:22.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:22.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:22.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:23.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:23.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:23.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:23.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:24.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:24.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:24.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:24.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:24.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:24.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:25.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:25.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:26.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:26.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:26.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:26.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:27.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:27.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:27.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:27.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:28.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:28.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:28.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:28.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:29.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:29.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:29.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:29.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:30.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:30.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:30.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:30.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:31.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:31.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:31.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:31.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:32.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:32.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:32.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:32.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:33.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:33.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:33.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:33.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:34.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:34.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:34.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:34.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:35.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:35.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:35.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:35.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:36.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:36.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:36.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:36.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:37.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:37.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:37.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:37.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:38.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:38.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:38.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:38.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:39.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:39.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:39.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:39.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:40.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:40.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:40.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:40.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:41.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:41.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:41.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:41.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:42.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:42.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:42.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:42.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:43.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:43.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:43.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:43.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:44.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:44.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:44.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:44.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:45.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:45.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:45.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:45.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:46.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:46.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:46.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:46.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:47.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:47.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:47.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:47.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:47.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:47.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:48.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:48.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:48.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:48.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:49.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:49.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:49.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:49.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:50.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:50.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:50.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:50.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:51.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:51.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:51.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:51.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:52.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:52.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:52.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:52.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:53.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:53.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:53.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:53.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:54.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:54.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:54.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:54.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:55.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:55.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:55.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:55.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:56.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:56.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:56.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:56.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:57.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:57.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:57.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:57.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:58.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:58.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:58.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:58.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:59.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:13:59.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:13:59.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:13:59.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:00.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:00.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:00.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:00.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:01.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:01.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:01.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:01.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:02.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:02.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:02.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:02.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:03.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:03.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:03.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:03.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:04.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:04.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:04.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:04.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:05.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:05.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:05.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:05.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:06.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:06.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:06.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:06.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:07.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:07.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:07.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:07.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:08.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:08.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:08.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:08.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:09.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:09.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:09.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:09.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:10.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:10.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:10.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:10.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:11.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:11.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:11.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:11.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:12.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:12.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:12.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:12.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:13.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:13.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:13.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:13.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:14.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:14.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:14.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:14.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:15.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:15.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:15.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:15.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:16.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:16.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:16.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:16.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:17.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:17.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:17.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:17.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:18.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:18.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:18.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:18.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:19.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:19.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:19.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:19.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:20.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:20.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:20.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:20.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:21.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:21.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:21.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:21.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:22.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:22.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:22.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:22.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:23.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:23.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:23.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:23.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:24.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:24.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:24.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:24.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:25.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:25.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:25.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:25.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:26.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:26.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:26.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:26.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:27.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:27.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:27.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:27.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:28.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:28.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:28.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:28.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:29.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:29.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:29.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:29.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:30.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:30.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:30.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:30.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:31.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:31.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:31.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:31.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:32.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:32.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:32.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:32.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:33.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:33.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:33.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:33.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:34.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:34.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:35.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:35.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:35.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:35.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:36.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:36.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:36.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:36.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:37.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:37.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:37.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:37.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:38.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:38.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:38.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:38.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:39.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:39.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:39.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:39.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:40.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:40.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:40.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:40.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:41.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:41.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:41.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:41.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:42.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:42.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:42.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:42.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:43.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:43.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:43.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:43.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:44.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:44.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:44.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:44.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:45.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:45.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:45.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:45.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:46.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:46.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:46.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:46.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:47.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:47.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:47.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:47.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:48.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:48.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:48.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:48.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:49.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:49.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:49.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:49.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:50.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:50.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:50.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:50.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:51.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:51.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:51.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:51.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:52.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:52.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:52.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:52.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:53.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:53.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:53.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:53.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:54.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:54.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:54.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:54.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:55.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:55.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:55.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:55.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:56.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:56.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:56.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:56.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:57.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:57.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:57.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:57.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:58.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:58.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:58.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:58.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:59.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:14:59.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:14:59.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:14:59.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:00.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:00.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:00.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:00.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:01.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:01.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:01.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:01.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:02.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:02.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:02.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:02.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:03.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:03.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:03.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:03.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:04.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:04.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:04.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:04.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:05.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:05.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:05.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:05.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:06.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:06.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:06.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:06.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:07.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:07.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:07.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:07.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:08.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:08.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:08.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:08.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:09.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:09.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:09.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:09.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:10.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:10.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:10.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:10.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:11.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:11.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:11.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:11.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:12.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:12.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:12.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:12.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:13.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:13.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:13.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:13.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:14.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:14.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:14.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:14.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:15.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:15.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:15.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:15.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:16.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:16.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:16.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:16.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:17.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:17.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:17.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:17.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:18.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:18.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:18.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:18.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:19.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:19.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:19.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:19.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:20.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:20.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:20.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:20.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:21.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:21.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:21.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:21.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:22.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:22.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:22.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:22.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:23.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:23.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:23.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:23.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:24.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:24.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:24.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:24.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:25.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:25.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:25.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:25.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:26.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:26.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:26.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:26.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:27.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:27.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:27.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:27.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:28.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:28.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:28.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:28.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:29.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:29.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:29.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:29.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:30.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:30.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:30.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:30.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:31.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:31.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:31.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:31.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:32.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:32.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:32.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:32.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:33.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:33.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:33.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:33.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:34.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:34.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:34.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:34.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:35.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:35.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:35.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:35.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:36.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:36.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:36.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:36.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:37.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:37.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:37.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:37.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:38.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:38.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:38.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:38.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:38.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:38.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:39.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:39.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:39.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:39.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:40.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:40.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:40.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:40.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:41.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:41.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:41.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:41.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:42.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:42.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:42.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:42.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:43.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:43.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:43.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:43.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:44.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:44.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:44.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:44.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:45.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:45.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:45.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:45.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:46.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:46.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:46.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:46.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:47.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:47.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:47.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:47.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:48.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:48.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:48.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:48.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:49.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:49.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:49.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:49.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:50.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:50.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:50.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:50.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:51.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:51.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:52.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:52.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:52.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:52.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:53.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:53.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:53.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:53.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:54.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:54.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:54.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:54.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:55.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:55.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:55.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:55.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:56.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:56.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:56.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:56.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:57.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:57.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:57.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:57.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:58.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:58.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:58.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:58.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:59.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:15:59.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:15:59.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:15:59.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:00.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:00.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:00.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:00.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:01.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:01.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:01.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:01.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:02.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:02.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:02.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:02.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:03.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:03.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:03.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:03.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:04.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:04.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:04.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:04.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:05.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:05.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:05.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:05.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:06.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:06.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:06.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:06.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:07.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:07.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:07.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:07.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:08.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:08.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:08.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:08.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:09.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:09.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:09.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:09.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:10.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:10.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:10.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:10.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:11.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:11.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:11.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:11.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:12.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:12.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:12.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:12.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:13.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:13.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:13.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:13.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:14.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:14.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:14.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:14.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:15.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:15.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:15.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:15.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:16.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:16.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:16.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:16.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:17.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:17.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:17.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:17.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:18.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:18.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:18.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:18.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:19.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:19.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:19.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:19.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:20.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:20.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:20.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:20.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:21.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:21.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:21.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:21.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:22.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:22.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:22.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:22.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:23.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:23.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:23.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:23.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:24.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:24.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:24.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:24.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:25.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:25.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:25.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:25.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:26.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:26.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:26.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:26.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:27.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:27.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:27.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:27.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:28.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:28.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:28.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:28.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:29.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:29.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:29.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:29.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:30.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:30.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:30.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:30.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:31.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:31.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:31.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:31.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:32.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:32.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:32.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:32.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:33.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:33.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:33.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:33.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:34.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:34.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:34.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:34.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:35.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:35.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:35.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:35.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:36.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:36.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:36.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:36.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:37.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:37.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:37.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:37.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:38.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:38.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:38.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:38.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:39.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:39.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:39.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:39.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:40.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:40.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:40.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:40.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:41.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:41.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:41.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:41.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:42.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:42.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:42.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:42.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:43.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:43.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:43.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:43.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:44.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:44.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:44.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:44.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:45.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:45.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:45.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:45.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:46.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:46.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:46.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:46.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:47.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:47.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:47.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:47.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:48.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:48.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:48.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:48.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:49.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:49.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:49.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:49.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:50.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:50.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:50.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:50.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:51.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:51.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:51.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:51.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:52.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:52.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:52.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:52.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:53.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:53.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:53.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:53.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:54.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:54.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:54.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:54.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:55.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:55.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:55.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:55.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:56.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:56.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:56.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:56.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:57.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:57.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:57.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:57.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:58.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:58.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:58.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:58.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:59.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:16:59.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:16:59.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:16:59.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:00.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:00.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:00.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:00.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:01.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:01.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:01.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:01.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:02.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:02.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:02.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:02.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:03.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:03.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:03.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:03.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:04.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:04.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:04.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:04.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:05.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:05.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:05.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:05.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:06.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:06.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:06.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:06.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:07.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:07.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:07.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:07.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:08.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:08.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:08.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:08.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:09.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:09.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:09.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:09.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:10.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:10.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:10.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:10.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:11.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:11.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:11.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:11.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:12.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:12.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:12.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:12.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:13.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:13.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:13.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:13.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:14.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:14.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:14.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:14.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:15.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:15.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:15.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:15.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:16.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:16.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:16.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:16.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:17.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:17.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:18.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:18.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:18.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:18.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:18.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:18.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:19.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:19.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:19.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:19.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:20.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:20.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:20.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:20.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:21.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:21.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:21.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:21.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:22.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:22.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:22.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:22.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:23.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:23.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:23.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:23.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:24.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:24.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:24.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:24.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:25.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:25.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:25.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:25.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:26.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:26.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:26.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:26.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:27.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:27.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:27.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:27.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:28.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:28.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:28.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:28.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:29.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:29.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:29.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:29.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:30.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:30.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:30.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:30.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:31.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:31.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:31.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:31.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:32.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:32.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:32.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:32.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:33.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:33.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:33.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:33.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:34.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:34.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:34.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:34.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:35.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:35.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:35.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:35.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:36.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:36.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:36.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:36.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:37.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:37.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:37.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:37.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:38.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:38.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:38.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:38.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:39.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:39.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:39.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:39.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:40.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:40.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:40.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:40.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:41.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:41.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:41.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:41.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:42.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:42.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:42.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:42.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:43.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:43.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:43.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:43.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:44.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:44.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:44.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:44.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:45.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:45.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:45.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:45.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:46.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:46.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:46.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:46.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:47.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:47.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:47.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:47.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:48.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:48.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:48.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:48.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:49.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:49.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:49.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:49.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:50.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:50.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:50.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:50.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:51.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:51.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:51.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:51.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:52.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:52.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:52.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:52.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:53.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:53.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:53.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:53.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:54.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:54.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:54.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:54.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:55.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:55.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:55.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:55.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:56.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:56.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:56.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:56.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:57.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:57.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:57.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:57.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:58.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:58.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:58.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:58.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:59.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:17:59.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:17:59.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:17:59.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:00.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:00.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:00.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:00.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:01.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:01.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:01.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:01.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:02.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:02.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:02.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:02.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:03.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:03.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:03.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:03.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:04.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:04.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:04.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:04.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:05.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:05.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:05.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:05.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:06.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:06.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:06.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:06.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:07.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:07.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:07.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:07.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:08.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:08.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:08.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:08.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:09.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:09.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:09.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:09.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:10.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:10.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:10.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:10.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:11.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:11.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:11.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:11.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:12.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:12.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:12.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:12.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:13.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:13.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:13.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:13.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:14.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:14.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:14.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:14.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:15.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:15.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:15.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:15.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:16.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:16.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:16.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:16.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:17.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:17.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:17.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:17.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:18.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:18.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:19.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:19.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:19.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:19.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:19.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:19.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:20.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:20.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:20.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:20.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:21.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:21.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:21.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:21.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:22.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:22.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:22.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:22.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:23.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:23.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:23.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:23.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:24.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:24.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:24.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:24.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:25.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:25.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:25.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:25.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:26.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:26.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:26.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:26.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:27.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:27.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:27.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:27.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:28.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:28.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:28.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:28.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:29.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:29.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:29.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:29.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:30.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:30.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:30.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:30.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:31.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:31.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:31.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:31.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:32.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:32.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:32.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:32.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:33.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:33.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:33.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:33.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:34.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:34.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:34.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:34.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:35.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:35.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:35.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:35.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:36.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:36.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:36.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:36.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:37.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:37.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:37.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:37.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:38.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:38.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:39.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:39.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:39.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:39.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:40.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:40.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:40.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:40.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:41.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:41.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:42.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:42.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:42.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:42.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:43.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:43.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:43.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:43.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:44.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:44.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:44.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:44.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:45.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:45.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:45.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:45.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:46.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:46.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:46.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:46.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:46.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:46.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:47.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:47.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:48.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:48.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:48.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:48.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:48.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:48.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:49.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:49.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:49.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:49.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:50.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:50.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:50.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:50.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:51.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:51.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:51.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:51.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:52.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:51.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:52.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:52.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:53.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:53.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:54.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:54.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:54.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:54.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:55.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:55.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:55.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:55.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:56.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:56.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:56.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:56.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:56.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:56.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:57.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:57.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:57.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:57.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:58.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:58.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:59.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:18:58.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:18:59.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:18:59.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:00.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:00.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:00.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:00.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:01.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:01.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:01.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:01.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:01.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:01.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:02.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:01.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:02.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:02.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:02.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:02.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:03.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:03.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:03.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:03.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:04.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:04.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:05.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:04.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:05.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:05.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:05.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:05.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:06.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:06.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:07.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:07.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:08.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:08.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:08.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:08.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:08.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:08.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:09.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:09.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:09.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:09.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:10.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:10.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:10.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:10.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:11.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:11.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:11.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:11.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:12.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:12.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:12.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:12.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:13.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:13.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:13.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:13.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:14.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:14.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:14.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:14.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:15.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:15.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:15.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:15.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:16.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:16.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:16.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:16.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:17.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:17.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:17.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:17.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:18.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:18.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:18.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:18.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:19.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:19.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:19.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:19.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:20.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:20.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:20.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:20.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:21.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:21.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:21.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:21.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:22.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:22.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:22.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:22.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:23.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:23.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:23.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:23.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:24.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:24.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:24.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:24.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:25.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:25.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:25.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:25.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:26.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:26.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:27.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:27.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:27.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:27.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:27.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:27.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:28.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:28.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:28.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:28.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:29.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:29.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:30.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:30.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:30.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:30.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:31.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:30.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:31.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:31.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:31.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:31.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:32.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:32.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:32.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:32.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:33.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:33.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:33.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:33.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:34.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:34.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:34.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:34.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:35.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:35.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:36.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:36.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:36.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:36.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:37.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:37.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:37.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:37.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:38.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:38.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:38.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:38.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:39.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:39.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:39.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:39.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:40.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:40.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:40.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:40.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:41.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:41.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:41.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:41.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:42.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:42.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:42.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:42.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:43.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:43.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:43.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:43.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:44.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:44.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:44.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:44.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:45.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:45.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:45.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:45.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:46.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:46.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:46.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:47.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:47.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:47.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:47.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:48.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:48.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:48.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:48.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:49.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:49.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:49.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:49.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:50.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:50.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:50.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:50.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:51.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:51.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:51.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:51.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:52.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:52.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:52.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:52.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:53.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:53.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:53.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:53.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:54.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:54.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:54.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:54.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:55.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:55.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:55.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:55.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:56.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:56.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:56.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:56.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:57.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:57.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:57.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:57.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:58.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:58.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:58.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:58.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:59.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:19:59.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:19:59.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:19:59.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:00.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:00.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:00.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:00.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:01.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:01.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:01.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:01.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:02.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:02.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:02.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:02.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:03.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:03.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:03.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:03.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:04.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:04.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:04.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:04.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:05.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:05.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:05.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:05.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:06.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:06.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:06.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:06.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:07.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:07.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:07.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:07.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:08.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:08.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:08.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:08.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:09.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:09.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:09.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:09.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:10.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:10.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:10.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:10.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:11.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:11.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:11.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:11.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:12.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:12.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:12.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:12.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:13.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:13.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:13.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:13.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:14.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:14.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:14.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:14.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:15.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:15.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:15.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:15.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:16.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:16.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:16.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:16.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:17.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:17.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:17.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:17.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:18.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:18.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:18.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:18.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:19.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:19.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:19.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:19.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:20.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:20.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:20.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:20.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:21.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:21.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:21.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:21.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:22.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:22.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:22.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:22.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:23.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:23.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:23.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:23.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:24.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:24.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:24.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:24.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:25.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:25.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:25.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:25.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:26.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:26.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:26.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:26.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:27.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:27.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:27.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:27.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:28.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:28.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:28.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:28.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:29.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:29.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:29.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:29.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:30.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:30.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:30.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:30.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:31.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:31.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:31.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:31.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:32.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:32.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:32.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:32.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:33.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:33.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:33.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:33.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:34.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:34.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:34.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:34.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:35.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:35.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:35.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:35.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:36.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:36.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:36.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:36.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:37.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:37.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:37.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:37.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:38.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:38.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:38.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:38.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:39.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:39.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:39.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:39.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:40.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:40.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:40.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:40.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:41.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:41.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:41.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:41.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:42.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:42.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:42.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:42.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:43.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:43.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:43.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:43.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:44.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:44.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:44.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:44.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:45.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:45.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:45.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:45.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:46.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:46.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:46.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:46.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:47.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:47.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:47.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:47.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:48.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:48.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:48.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:48.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:49.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:49.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:49.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:49.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:50.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:50.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:50.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:50.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:51.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:51.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:51.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:51.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:52.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:52.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:52.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:52.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:53.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:53.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:53.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:53.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:54.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:54.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:54.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:54.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:55.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:55.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:55.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:55.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:56.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:56.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:56.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:56.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:57.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:57.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:57.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:57.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:58.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:58.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:58.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:58.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:59.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:20:59.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:20:59.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:20:59.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:00.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:00.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:00.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:00.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:01.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:01.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:01.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:01.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:02.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:02.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:02.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:02.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:03.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:03.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:03.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:03.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:04.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:04.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:04.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:04.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:05.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:05.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:05.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:05.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:06.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:06.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:06.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:06.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:07.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:07.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:07.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:07.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:08.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:08.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:08.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:08.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:09.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:09.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:09.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:09.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:10.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:10.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:10.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:10.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:11.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:11.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:11.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:11.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:12.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:12.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:12.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:12.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:13.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:13.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:13.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:13.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:14.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:14.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:14.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:14.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:15.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:15.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:15.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:15.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:16.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:16.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:16.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:16.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:17.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:17.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:17.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:17.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:18.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:18.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:18.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:18.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:19.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:19.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:19.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:19.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:20.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:20.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:20.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:20.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:21.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:21.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:21.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:21.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:22.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:22.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:22.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:22.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:23.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:23.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:23.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:23.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:24.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:24.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:24.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:24.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:25.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:25.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:25.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:25.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:26.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:26.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:26.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:26.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:27.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:27.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:27.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:27.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:28.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:28.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:28.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:28.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:29.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:29.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:29.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:29.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:30.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:30.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:30.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:30.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:31.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:31.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:31.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:31.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:32.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:32.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:32.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:32.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:33.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:33.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:33.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:33.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:34.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:34.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:34.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:34.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:35.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:35.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:35.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:35.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:36.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:36.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:36.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:36.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:37.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:37.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:37.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:37.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:38.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:38.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:38.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:38.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:39.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:39.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:39.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:39.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:40.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:40.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:40.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:40.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:41.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:41.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:41.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:41.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:42.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:42.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:42.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:42.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:43.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:43.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:43.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:43.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:44.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:44.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:44.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:44.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:45.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:45.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:45.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:45.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:46.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:46.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:46.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:46.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:47.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:47.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:47.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:47.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:48.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:48.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:48.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:48.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:49.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:49.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:49.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:49.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:50.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:50.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:50.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:50.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:51.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:51.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:51.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:51.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:52.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:52.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:52.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:52.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:53.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:53.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:53.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:53.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:54.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:54.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:54.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:54.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:55.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:55.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:55.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:55.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:56.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:56.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:56.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:56.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:57.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:57.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:57.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:57.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:58.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:58.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:58.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:58.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:59.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:21:59.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:21:59.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:21:59.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:00.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:00.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:00.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:00.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:01.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:01.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:01.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:01.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:02.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:02.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:02.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:02.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:03.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:03.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:03.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:03.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:04.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:04.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:04.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:04.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:05.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:05.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:05.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:05.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:06.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:06.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:06.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:06.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:07.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:07.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:07.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:07.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:08.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:08.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:08.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:08.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:09.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:09.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:09.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:09.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:10.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:10.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:10.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:10.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:11.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:11.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:11.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:11.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:12.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:12.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:12.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:12.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:13.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:13.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:13.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:13.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:14.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:14.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:14.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:14.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:15.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:15.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:15.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:15.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:16.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:16.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:16.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:16.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:17.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:17.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:17.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:17.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:18.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:18.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:18.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:18.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:19.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:19.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:19.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:19.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:20.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:20.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:20.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:20.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:21.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:21.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:21.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:21.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:22.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:22.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:22.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:22.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:23.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:23.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:23.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:23.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:24.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:24.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:24.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:24.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:25.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:25.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:25.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:25.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:26.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:26.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:26.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:26.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:27.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:27.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:27.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:27.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:28.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:28.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:28.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:28.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:29.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:29.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:29.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:29.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:30.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:30.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:30.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:30.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:31.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:31.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:31.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:31.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:32.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:32.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:32.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:32.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:33.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:33.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:33.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:33.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:34.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:34.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:34.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:34.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:35.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:35.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:35.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:35.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:36.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:36.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:36.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:36.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:37.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:37.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:37.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:37.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:38.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:38.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:38.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:38.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:39.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:39.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:39.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:39.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:40.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:40.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:40.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:40.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:41.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:41.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:41.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:41.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:42.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:42.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:42.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:42.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:43.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:43.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:44.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:44.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:44.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:44.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:45.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:45.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:45.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:45.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:46.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:46.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:46.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:46.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:47.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:47.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:47.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:47.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:48.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:48.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:48.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:48.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:49.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:49.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:49.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:49.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:50.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:50.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:50.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:50.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:51.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:51.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:51.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:51.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:52.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:52.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:52.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:52.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:53.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:53.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:53.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:53.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:54.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:54.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:54.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:54.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:54.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:54.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:55.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:55.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:55.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:55.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:56.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:56.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:56.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:56.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:57.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:57.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:57.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:57.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:58.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:58.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:58.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:58.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:59.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:22:59.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:22:59.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:22:59.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:00.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:00.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:00.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:00.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:01.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:01.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:01.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:01.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:02.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:02.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:02.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:02.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:03.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:03.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:03.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:03.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:04.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:04.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:04.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:04.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:05.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:05.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:05.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:05.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:06.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:06.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:06.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:06.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:07.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:07.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:07.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:07.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:08.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:08.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:08.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:08.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:09.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:09.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:09.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:09.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:10.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:10.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:10.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:10.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:11.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:11.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:11.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:11.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:12.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:12.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:12.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:12.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:13.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:13.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:13.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:13.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:14.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:14.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:14.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:14.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:15.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:15.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:15.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:15.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:16.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:16.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:16.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:16.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:17.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:17.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:17.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:17.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:18.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:18.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:18.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:18.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:19.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:19.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:19.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:19.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:20.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:20.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:20.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:20.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:21.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:21.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:21.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:21.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:22.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:22.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:22.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:22.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:23.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:23.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:23.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:23.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:24.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:24.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:24.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:24.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:25.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:25.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:25.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:25.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:26.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:26.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:26.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:26.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:27.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:27.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:27.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:27.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:28.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:28.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:29.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:29.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:29.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:29.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:30.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:30.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:30.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:30.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:31.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:31.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:31.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:31.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:32.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:32.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:32.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:32.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:33.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:33.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:33.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:33.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:34.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:34.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:34.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:34.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:35.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:35.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:35.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:35.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:35.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:35.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:36.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:36.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:36.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:36.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:37.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:37.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:37.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:37.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:38.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:38.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:38.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:38.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:39.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:39.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:39.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:39.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:40.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:40.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:41.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:41.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:41.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:41.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:42.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:41.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:42.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:42.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:42.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:42.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:43.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:43.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:43.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:43.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:44.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:44.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:45.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:45.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:45.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:45.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:45.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:45.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:46.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:46.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:46.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:46.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:47.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:47.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:47.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:47.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:48.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:48.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:48.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:48.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:49.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:49.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:49.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:49.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:50.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:50.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:50.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:50.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:51.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:51.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:51.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:51.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:52.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:52.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:52.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:52.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:53.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:53.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:53.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:53.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:54.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:54.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:54.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:54.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:55.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:55.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:55.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:55.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:56.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:56.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:56.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:56.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:57.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:57.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:57.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:57.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:58.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:58.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:58.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:58.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:59.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:23:59.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:23:59.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:23:59.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:00.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:00.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:00.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:00.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:01.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:01.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:01.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:01.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:02.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:02.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:02.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:02.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:03.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:03.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:03.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:03.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:04.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:04.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:04.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:04.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:05.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:05.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:05.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:05.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:06.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:06.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:06.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:06.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:07.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:07.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:07.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:07.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:08.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:08.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:08.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:08.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:09.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:09.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:09.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:09.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:10.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:10.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:10.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:10.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:11.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:11.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:11.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:11.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:12.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:12.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:12.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:12.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:13.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:13.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:13.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:13.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:14.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:14.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:14.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:14.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:15.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:15.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:15.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:15.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:16.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:16.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:16.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:16.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:17.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:17.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:17.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:17.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:18.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:18.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:18.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:18.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:19.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:19.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:19.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:19.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:20.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:20.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:20.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:20.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:21.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:21.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:21.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:21.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:22.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:22.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:22.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:22.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:23.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:23.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:23.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:23.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:24.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:24.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:24.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:24.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:25.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:25.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:25.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:25.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:26.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:26.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:26.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:26.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:27.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:27.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:27.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:27.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:28.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:28.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:28.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:28.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:29.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:29.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:29.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:29.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:30.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:30.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:30.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:30.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:31.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:31.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:31.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:31.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:32.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:32.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:32.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:32.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:33.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:33.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:33.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:33.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:34.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:34.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:34.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:34.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:35.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:35.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:35.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:35.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:36.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:36.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:36.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:36.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:37.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:37.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:37.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:37.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:38.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:38.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:39.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:39.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:39.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:39.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:39.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:39.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:40.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:40.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:41.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:41.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:41.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:41.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:41.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:41.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:42.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:42.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:42.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:42.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:43.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:43.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:43.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:43.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:43.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:43.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:44.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:44.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:45.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:45.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:45.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:45.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:46.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:46.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:46.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:46.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:47.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:47.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:47.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:47.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:48.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:48.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:48.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:48.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:49.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:49.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:49.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:49.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:50.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:50.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:50.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:50.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:51.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:51.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:51.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:51.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:52.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:52.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:52.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:52.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:53.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:53.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:53.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:53.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:54.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:54.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:54.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:54.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:55.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:55.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:55.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:55.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:56.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:56.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:56.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:56.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:57.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:57.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:57.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:57.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:58.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:58.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:58.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:58.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:59.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:24:59.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:24:59.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:24:59.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:00.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:00.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:00.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:00.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:01.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:01.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:01.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:01.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:02.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:02.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:02.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:02.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:03.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:03.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:03.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:03.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:04.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:04.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:04.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:04.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:05.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:05.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:05.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:05.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:06.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:06.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:06.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:06.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:07.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:07.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:07.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:07.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:08.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:08.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:08.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:08.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:09.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:09.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:09.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:09.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:10.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:10.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:10.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:10.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:11.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:11.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:11.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:11.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:12.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:12.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:12.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:12.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:13.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:13.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:13.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:13.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:14.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:14.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:14.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:14.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:15.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:15.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:15.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:15.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:16.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:16.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:16.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:16.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:17.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:17.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:17.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:17.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:18.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:18.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:18.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:18.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:19.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:19.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:19.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:19.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:20.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:20.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:20.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:20.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:21.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:21.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:21.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:21.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:22.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:22.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:22.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:22.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:23.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:23.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:23.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:23.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:24.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:24.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:24.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:24.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:25.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:25.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:25.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:25.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:26.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:26.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:26.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:26.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:27.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:27.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:27.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:27.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:28.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:28.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:28.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:28.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:29.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:29.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:29.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:29.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:30.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:30.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:30.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:30.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:31.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:31.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:31.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:31.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:32.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:32.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:32.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:32.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:33.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:33.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:33.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:33.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:34.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:34.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:34.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:34.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:35.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:35.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:35.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:35.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:36.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:36.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:36.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:36.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:37.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:37.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:37.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:37.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:38.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:38.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:38.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:38.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:39.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:39.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:39.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:39.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:40.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:40.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:40.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:40.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:41.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:41.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:41.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:41.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:42.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:42.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:42.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:42.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:43.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:43.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:43.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:43.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:44.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:44.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:44.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:44.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:45.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:45.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:45.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:45.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:46.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:46.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:46.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:46.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:47.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:47.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:47.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:47.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:48.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:48.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:48.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:48.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:49.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:49.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:49.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:49.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:50.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:50.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:50.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:50.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:51.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:51.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:51.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:51.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:52.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:52.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:52.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:52.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:53.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:53.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:54.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:54.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:54.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:54.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:55.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:55.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:55.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:55.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:56.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:56.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:56.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:56.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:57.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:57.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:57.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:57.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:58.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:58.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:58.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:58.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:59.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:59.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:59.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:25:59.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:25:59.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:25:59.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:00.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:00.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:00.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:00.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:01.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:01.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:02.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:02.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:02.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:02.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:02.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:02.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:03.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:03.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:03.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:03.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:04.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:04.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:04.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:04.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:05.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:05.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:05.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:05.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:06.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:06.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:06.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:06.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:07.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:07.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:08.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:08.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:08.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:08.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:09.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:09.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:09.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:09.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:10.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:10.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:10.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:10.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:11.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:11.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:11.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:11.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:12.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:12.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:12.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:12.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:12.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:12.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:13.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:13.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:13.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:13.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:14.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:14.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:15.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:15.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:15.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:15.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:16.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:16.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:16.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:16.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:16.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:16.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:17.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:17.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:17.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:17.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:18.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:18.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:18.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:18.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:19.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:19.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:19.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:19.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:20.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:19.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:20.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:20.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:21.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:21.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:21.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:21.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:21.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:21.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:22.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:22.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:23.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:22.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:23.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:23.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:24.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:24.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:24.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:25.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:25.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:25.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:25.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:26.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:26.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:26.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:26.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:27.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:27.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:27.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:27.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:28.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:28.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:29.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:29.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:29.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:29.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:30.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:30.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:30.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:30.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:30.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:30.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:31.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:31.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:31.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:31.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:32.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:32.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:32.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:32.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:33.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:33.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:33.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:33.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:34.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:34.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:35.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:35.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:35.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:35.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:36.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:36.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:36.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:36.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:37.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:37.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:37.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:37.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:38.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:38.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:38.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:38.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:39.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:39.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:39.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:39.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:40.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:40.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:40.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:40.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:41.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:41.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:41.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:41.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:42.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:42.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:42.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:42.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:43.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:43.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:43.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:43.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:44.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:44.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:44.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:44.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:45.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:45.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:45.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:45.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:46.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:46.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:46.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:46.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:47.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:47.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:47.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:47.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:48.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:48.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:48.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:48.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:49.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:49.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:49.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:49.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:50.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:50.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:50.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:50.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:51.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:51.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:51.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:51.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:51.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:51.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:52.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:52.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:53.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:53.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:53.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:53.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:54.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:54.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:54.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:54.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:55.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:55.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:55.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:55.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:56.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:56.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:56.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:56.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:57.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:57.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:57.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:57.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:58.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:58.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:58.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:58.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:58.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:26:58.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:26:59.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:26:59.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:00.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:00.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:00.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:00.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:00.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:00.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:01.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:01.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:01.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:01.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:02.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:02.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:02.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:02.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:03.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:03.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:03.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:03.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:04.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:04.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:04.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:04.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:05.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:05.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:05.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:05.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:06.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:06.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:06.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:06.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:07.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:07.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:08.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:08.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:08.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:08.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:08.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:08.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:09.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:09.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:09.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:09.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:10.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:10.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:10.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:10.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:11.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:11.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:11.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:11.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:12.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:12.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:13.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:13.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:13.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:13.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:13.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:13.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:14.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:14.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:14.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:14.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:15.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:15.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:15.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:15.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:16.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:16.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:17.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:17.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:17.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:17.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:18.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:18.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:18.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:18.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:18.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:18.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:19.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:19.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:19.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:19.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:20.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:20.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:21.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:21.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:21.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:21.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:22.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:22.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:22.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:22.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:23.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:23.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:23.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:23.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:24.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:24.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:24.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:24.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:25.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:25.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:25.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:25.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:26.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:26.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:26.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:26.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:26.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:26.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:27.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:27.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:27.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:27.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:28.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:28.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:28.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:28.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:29.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:29.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:29.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:29.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:30.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:30.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:30.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:30.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:31.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:31.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:31.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:31.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:32.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:32.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:32.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:32.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:33.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:33.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:34.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:33.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:34.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:34.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:35.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:34.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:35.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:35.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:36.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:36.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:36.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:36.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:37.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:36.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:37.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:37.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:38.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:38.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:38.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:38.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:39.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:39.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:39.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:39.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:40.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:40.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:40.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:40.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:41.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:41.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:41.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:41.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:42.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:42.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:42.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:42.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:43.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:43.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:43.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:43.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:44.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:44.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:44.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:44.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:45.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:45.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:45.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:45.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:46.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:46.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:46.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:46.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:47.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:47.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:47.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:47.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:48.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:48.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:48.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:48.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:49.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:49.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:49.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:49.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:50.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:50.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:50.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:50.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:51.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:51.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:51.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:51.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:52.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:52.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:52.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:52.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:53.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:53.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:53.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:53.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:54.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:54.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:54.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:54.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:55.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:55.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:55.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:55.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:56.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:56.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:56.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:56.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:57.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:57.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:57.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:57.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:58.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:58.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:58.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:58.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:59.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:27:59.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:27:59.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:27:59.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:00.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:00.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:00.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:00.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:01.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:01.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:01.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:01.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:02.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:02.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:02.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:02.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:03.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:03.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:03.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:03.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:04.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:04.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:04.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:04.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:05.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:05.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:05.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:05.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:06.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:06.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:06.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:06.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:07.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:07.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:07.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:07.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:08.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:08.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:08.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:08.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:09.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:09.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:09.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:09.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:10.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:10.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:10.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:10.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:11.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:11.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:11.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:11.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:12.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:12.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:12.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:12.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:13.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:13.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:13.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:13.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:14.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:14.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:14.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:14.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:15.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:15.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:15.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:15.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:16.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:16.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:16.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:16.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:17.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:17.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:17.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:17.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:18.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:18.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:18.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:18.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:19.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:19.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:19.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:19.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:20.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:20.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:20.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:20.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:21.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:21.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:21.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:21.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:22.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:22.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:22.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:22.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:23.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:23.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:23.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:23.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:24.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:24.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:24.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:24.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:25.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:25.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:25.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:25.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:26.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:26.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:26.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:26.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:27.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:27.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:27.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:27.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:28.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:28.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:28.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:28.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:29.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:29.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:29.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:29.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:30.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:30.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:30.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:30.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:31.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:31.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:31.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:31.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:32.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:32.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:32.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:33.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:33.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:34.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:34.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:34.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:34.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:34.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:34.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:35.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:35.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:35.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:35.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:36.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:36.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:36.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:36.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:37.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:37.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:37.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:37.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:38.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:38.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:38.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:38.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:39.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:39.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:39.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:39.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:40.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:40.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:41.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:41.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:41.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:41.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:42.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:42.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:42.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:42.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:43.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:42.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:43.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:43.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:44.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:44.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:44.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:44.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:45.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:45.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:45.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:45.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:46.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:46.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:46.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:46.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:46.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:46.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:47.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:47.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:47.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:47.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:48.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:48.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:48.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:48.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:49.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:49.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:49.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:49.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:50.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:50.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:51.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:51.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:51.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:51.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:52.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:52.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:52.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:52.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:53.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:53.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:53.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:53.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:54.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:54.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:54.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:54.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:55.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:55.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:55.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:55.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:56.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:56.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:56.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:56.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:57.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:57.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:57.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:57.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:58.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:58.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:58.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:58.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:59.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:28:59.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:28:59.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:28:59.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:00.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:00.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:00.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:00.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:01.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:01.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:01.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:01.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:02.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:02.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:02.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:02.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:03.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:03.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:03.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:03.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:04.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:04.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:04.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:04.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:05.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:05.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:05.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:05.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:06.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:06.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:06.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:06.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:07.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:07.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:07.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:07.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:08.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:08.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:08.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:08.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:08.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:08.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:09.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:09.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:10.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:09.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:10.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:10.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:11.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:11.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:11.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:11.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:12.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:12.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:12.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:12.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:13.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:13.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:13.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:13.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:14.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:14.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:14.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:14.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:14.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:14.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:15.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:15.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:15.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:15.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:16.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:16.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:16.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:16.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:17.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:17.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:17.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:17.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:18.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:18.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:18.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:18.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:19.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:19.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:19.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:19.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:20.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:20.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:20.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:20.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:21.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:21.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:21.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:21.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:22.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:22.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:22.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:22.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:23.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:23.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:23.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:23.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:24.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:24.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:24.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:24.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:25.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:25.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:25.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:25.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:26.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:26.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:26.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:26.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:27.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:27.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:28.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:28.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:28.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:28.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:28.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:28.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:29.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:29.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:29.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:29.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:30.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:30.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:31.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:31.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:31.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:31.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:32.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:32.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:32.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:32.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:32.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:32.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:33.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:33.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:33.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:33.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:34.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:34.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:34.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:34.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:35.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:35.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:35.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:35.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:36.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:36.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:36.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:36.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:37.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:37.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:37.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:37.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:38.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:38.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:38.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:38.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:39.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:39.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:39.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:39.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:40.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:40.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:40.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:40.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:41.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:41.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:41.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:41.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:42.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:42.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:42.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:42.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:43.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:43.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:43.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:43.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:44.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:44.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:44.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:44.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:45.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:45.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:45.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:45.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:46.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:46.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:46.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:46.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:47.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:47.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:47.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:47.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:48.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:48.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:48.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:48.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:49.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:49.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:49.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:49.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:50.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:50.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:50.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:50.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:51.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:51.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:51.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:51.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:52.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:52.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:52.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:52.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:53.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:53.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:53.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:53.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:54.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:54.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:54.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:54.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:55.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:55.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:55.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:55.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:56.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:56.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:56.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:56.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:57.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:57.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:57.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:57.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:58.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:58.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:58.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:58.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:59.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:29:59.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:29:59.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:29:59.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:00.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:00.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:00.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:00.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:01.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:01.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:01.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:01.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:02.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:02.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:02.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:02.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:03.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:03.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:03.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:03.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:04.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:04.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:04.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:04.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:05.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:05.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:05.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:05.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:06.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:06.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:06.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:06.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:07.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:07.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:07.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:07.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:08.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:08.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:08.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:08.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:09.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:09.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:09.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:09.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:10.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:10.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:10.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:10.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:11.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:11.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:11.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:11.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:12.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:12.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:12.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:12.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:13.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:13.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:13.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:13.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:14.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:14.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:14.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:14.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:15.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:15.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:15.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:15.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:16.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:16.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:16.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:16.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:17.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:17.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:17.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:17.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:18.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:18.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:18.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:18.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:19.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:19.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:19.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:19.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:20.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:20.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:20.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:20.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:21.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:21.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:21.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:21.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:22.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:22.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:22.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:22.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:23.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:23.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:23.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:23.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:24.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:24.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:24.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:24.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:25.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:25.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:25.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:25.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:26.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:26.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:26.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:26.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:27.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:27.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:27.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:27.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:28.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:28.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:28.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:28.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:29.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:29.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:29.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:29.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:30.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:30.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:30.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:30.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:31.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:31.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:31.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:31.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:32.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:32.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:32.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:32.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:33.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:33.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:33.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:33.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:34.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:34.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:34.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:34.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:35.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:35.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:35.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:35.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:36.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:36.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:36.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:36.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:37.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:37.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:37.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:37.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:38.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:38.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:38.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:38.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:39.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:39.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:39.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:39.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:40.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:40.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:40.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:40.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:41.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:41.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:41.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:41.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:42.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:42.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:42.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:42.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:43.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:43.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:43.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:43.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:44.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:44.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:44.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:44.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:45.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:45.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:45.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:45.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:46.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:46.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:46.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:46.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:47.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:47.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:47.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:47.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:48.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:48.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:48.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:48.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:49.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:49.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:49.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:49.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:50.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:50.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:50.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:50.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:51.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:51.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:51.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:51.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:52.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:52.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:52.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:52.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:53.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:53.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:53.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:53.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:54.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:54.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:54.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:54.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:55.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:55.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:55.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:55.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:56.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:56.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:56.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:56.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:57.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:57.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:57.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:57.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:58.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:58.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:59.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:30:58.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:30:59.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:30:59.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:00.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:00.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:00.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:00.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:00.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:00.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:01.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:01.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:01.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:01.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:02.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:02.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:02.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:02.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:03.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:03.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:04.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:04.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:04.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:04.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:04.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:04.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:05.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:05.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:06.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:05.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:06.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:06.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:07.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:07.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:07.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:07.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:08.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:08.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:08.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:08.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:08.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:08.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:09.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:09.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:09.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:09.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:10.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:10.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:11.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:11.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:11.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:11.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:12.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:11.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:12.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:12.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:12.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:12.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:13.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:13.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:13.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:13.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:14.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:14.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:14.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:14.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:15.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:15.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:15.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:15.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:16.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:16.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:16.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:16.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:17.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:17.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:17.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:17.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:18.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:18.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:18.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:18.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:19.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:19.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:19.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:19.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:20.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:20.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:20.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:20.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:21.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:21.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:21.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:21.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:22.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:22.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:22.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:22.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:23.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:23.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:23.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:23.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:24.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:24.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:24.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:24.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:25.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:25.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:25.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:25.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:26.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:26.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:26.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:26.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:27.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:27.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:27.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:27.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:28.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:28.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:28.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:28.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:29.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:29.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:30.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:30.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:30.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:30.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:31.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:31.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:31.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:31.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:32.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:32.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:32.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:32.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:33.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:33.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:33.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:33.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:34.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:34.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:34.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:34.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:35.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:35.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:35.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:35.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:36.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:36.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:36.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:36.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:37.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:37.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:37.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:37.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:38.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:38.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:38.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:38.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:39.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:39.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:39.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:39.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:40.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:40.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:40.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:40.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:41.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:41.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:41.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:41.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:42.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:42.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:42.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:42.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:43.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:43.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:43.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:43.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:44.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:44.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:44.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:44.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:45.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:45.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:45.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:45.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:45.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:45.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:46.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:46.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:46.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:46.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:47.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:47.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:47.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:47.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:48.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:48.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:48.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:48.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:49.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:49.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:49.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:49.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:50.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:50.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:50.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:50.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:51.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:51.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:51.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:51.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:52.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:52.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:53.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:53.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:53.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:53.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:53.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:53.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:54.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:54.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:55.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:55.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:55.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:55.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:55.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:55.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:56.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:56.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:57.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:57.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:57.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:57.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:58.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:58.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:58.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:58.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:58.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:31:58.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:31:59.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:31:59.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:00.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:00.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:00.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:00.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:01.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:01.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:01.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:01.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:02.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:01.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:02.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:02.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:02.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:02.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:03.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:03.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:04.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:04.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:04.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:04.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:05.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:05.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:05.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:05.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:06.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:06.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:06.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:06.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:07.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:07.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:07.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:07.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:08.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:08.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:08.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:08.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:09.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:09.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:09.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:09.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:10.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:10.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:10.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:10.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:11.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:11.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:11.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:11.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:11.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:11.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:12.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:12.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:12.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:12.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:13.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:13.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:13.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:13.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:14.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:14.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:14.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:14.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:15.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:15.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:16.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:15.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:16.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:16.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:17.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:17.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:17.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:17.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:17.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:17.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:18.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:18.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:18.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:18.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:19.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:19.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:20.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:20.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:21.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:21.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:21.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:21.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:22.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:22.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:22.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:22.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:23.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:23.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:23.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:23.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:23.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:23.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:24.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:24.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:25.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:24.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:25.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:25.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:26.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:26.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:26.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:26.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:26.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:26.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:27.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:27.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:28.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:28.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:28.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:28.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:29.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:29.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:29.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:29.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:30.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:30.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:30.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:30.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:31.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:31.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:31.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:31.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:32.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:32.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:32.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:32.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:33.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:33.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:33.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:33.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:34.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:34.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:34.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:34.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:35.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:35.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:35.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:35.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:36.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:36.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:36.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:36.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:37.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:37.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:37.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:37.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:38.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:38.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:38.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:38.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:39.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:39.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:39.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:39.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:40.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:40.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:40.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:40.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:41.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:41.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:41.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:41.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:42.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:42.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:42.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:42.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:43.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:43.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:43.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:43.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:44.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:44.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:44.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:44.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:45.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:45.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:45.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:45.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:46.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:46.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:46.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:46.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:47.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:47.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:47.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:47.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:48.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:48.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:48.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:48.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:49.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:49.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:49.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:49.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:50.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:50.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:50.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:50.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:51.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:51.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:51.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:51.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:52.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:52.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:52.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:52.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:53.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:53.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:53.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:53.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:54.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:54.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:54.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:54.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:55.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:55.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:55.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:55.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:56.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:56.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:56.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:56.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:57.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:57.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:57.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:57.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:58.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:58.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:58.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:58.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:59.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:32:59.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:32:59.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:32:59.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:00.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:00.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:00.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:00.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:01.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:01.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:01.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:01.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:02.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:02.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:02.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:02.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:03.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:03.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:03.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:03.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:04.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:04.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:04.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:04.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:05.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:05.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:05.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:05.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:06.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:06.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:06.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:06.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:07.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:07.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:07.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:07.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:08.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:08.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:08.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:08.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:09.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:09.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:09.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:09.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:10.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:10.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:10.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:10.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:11.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:11.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:11.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:11.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:12.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:12.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:12.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:12.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:13.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:13.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:13.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:13.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:14.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:14.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:14.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:14.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:15.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:15.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:15.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:15.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:16.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:16.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:16.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:16.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:17.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:17.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:17.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:17.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:18.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:18.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:18.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:18.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:19.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:19.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:19.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:19.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:20.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:20.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:20.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:20.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:21.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:21.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:21.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:21.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:22.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:22.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:22.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:22.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:23.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:23.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:23.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:23.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:24.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:24.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:24.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:24.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:25.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:25.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:25.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:25.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:26.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:26.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:26.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:26.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:27.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:27.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:27.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:27.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:28.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:28.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:28.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:28.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:29.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:29.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:29.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:29.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:30.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:30.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:30.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:30.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:31.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:31.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:31.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:31.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:32.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:32.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:32.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:32.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:33.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:33.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:33.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:33.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:34.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:34.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:34.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:34.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:35.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:35.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:35.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:35.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:36.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:36.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:36.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:36.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:37.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:37.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:37.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:37.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:38.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:38.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:38.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:38.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:39.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:39.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:39.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:39.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:40.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:40.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:40.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:40.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:41.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:41.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:41.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:41.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:42.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:42.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:42.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:42.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:43.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:43.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:43.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:43.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:44.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:44.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:44.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:44.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:45.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:45.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:45.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:45.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:46.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:46.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:46.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:46.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:47.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:47.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:47.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:47.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:48.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:48.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:48.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:48.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:49.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:49.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:49.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:49.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:50.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:50.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:50.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:50.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:51.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:51.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:51.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:51.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:52.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:52.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:52.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:52.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:53.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:53.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:53.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:53.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:54.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:54.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:54.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:54.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:55.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:55.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:55.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:55.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:56.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:56.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:56.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:56.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:57.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:57.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:57.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:57.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:58.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:58.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:58.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:58.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:59.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:33:59.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:33:59.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:33:59.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:00.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:00.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:00.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:00.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:01.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:01.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:01.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:01.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:02.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:02.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:02.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:02.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:03.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:03.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:03.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:03.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:04.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:04.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:04.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:04.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:05.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:05.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:05.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:05.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:06.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:06.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:06.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:06.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:07.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:07.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:07.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:07.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:08.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:08.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:08.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:08.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:09.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:09.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:09.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:09.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:10.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:10.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:10.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:10.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:11.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:11.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:11.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:11.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:12.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:12.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:12.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:12.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:13.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:13.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:13.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:13.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:14.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:14.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:14.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:14.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:15.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:15.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:15.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:15.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:16.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:16.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:16.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:16.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:17.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:17.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:17.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:17.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:18.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:18.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:18.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:18.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:19.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:19.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:19.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:19.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:20.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:20.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:20.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:20.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:21.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:21.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:21.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:21.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:22.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:22.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:22.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:22.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:23.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:23.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:23.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:23.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:24.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:24.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:24.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:24.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:25.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:25.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:25.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:25.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:26.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:26.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:26.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:26.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:27.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:27.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:27.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:27.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:28.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:28.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:28.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:28.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:29.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:29.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:29.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:29.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:30.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:30.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:30.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:30.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:31.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:31.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:31.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:31.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:32.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:32.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:32.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:32.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:33.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:33.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:33.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:33.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:34.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:34.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:34.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:34.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:35.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:35.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:35.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:35.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:36.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:36.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:36.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:36.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:37.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:37.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:37.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:37.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:38.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:38.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:38.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:38.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:39.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:39.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:39.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:39.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:40.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:40.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:40.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:40.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:41.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:41.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:41.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:41.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:42.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:42.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:42.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:42.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:43.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:43.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:43.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:43.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:44.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:44.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:44.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:44.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:45.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:45.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:45.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:45.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:46.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:46.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:46.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:46.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:47.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:47.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:47.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:47.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:48.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:48.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:48.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:48.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:49.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:49.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:49.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:49.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:50.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:50.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:50.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:50.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:51.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:51.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:51.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:51.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:52.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:52.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:52.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:52.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:53.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:53.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:53.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:53.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:54.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:54.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:54.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:54.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:55.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:55.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:55.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:55.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:56.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:56.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:56.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:56.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:57.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:57.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:57.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:57.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:58.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:58.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:58.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:58.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:59.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:34:59.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:34:59.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:34:59.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:00.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:00.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:00.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:00.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:01.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:01.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:01.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:01.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:02.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:02.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:02.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:02.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:03.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:03.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:03.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:03.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:04.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:04.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:04.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:04.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:05.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:05.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:05.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:05.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:06.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:06.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:06.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:06.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:07.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:07.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:07.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:07.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:08.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:08.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:08.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:08.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:09.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:09.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:09.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:09.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:10.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:10.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:10.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:10.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:11.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:11.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:11.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:11.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:12.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:12.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:12.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:12.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:13.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:13.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:13.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:13.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:14.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:14.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:14.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:14.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:15.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:15.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:15.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:15.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:16.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:16.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:16.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:16.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:17.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:17.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:17.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:17.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:18.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:18.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:18.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:18.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:19.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:19.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:19.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:19.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:20.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:20.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:20.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:20.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:21.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:21.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:21.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:21.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:22.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:22.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:22.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:22.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:23.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:23.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:23.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:23.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:24.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:24.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:24.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:24.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:25.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:25.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:25.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:25.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:26.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:26.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:26.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:26.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:27.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:27.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:27.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:27.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:28.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:28.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:28.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:28.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:29.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:29.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:29.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:29.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:30.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:30.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:30.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:30.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:31.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:31.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:31.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:31.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:32.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:32.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:32.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:32.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:33.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:33.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:33.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:33.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:34.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:34.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:34.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:34.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:35.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:35.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:35.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:35.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:36.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:36.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:36.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:36.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:37.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:37.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:37.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:37.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:38.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:38.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:38.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:38.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:39.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:39.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:39.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:39.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:40.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:40.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:40.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:40.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:41.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:41.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:41.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:41.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:42.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:42.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:42.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:42.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:43.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:43.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:43.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:43.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:44.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:44.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:44.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:44.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:45.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:45.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:45.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:45.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:46.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:46.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:46.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:46.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:47.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:47.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:47.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:47.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:48.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:48.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:48.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:48.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:49.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:49.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:50.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:50.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:50.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:50.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:51.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:51.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:51.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:51.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:52.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:52.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:52.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:52.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:53.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:53.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:53.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:53.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:54.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:54.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:54.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:54.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:55.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:55.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:55.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:55.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:56.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:56.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:56.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:56.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:57.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:57.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:57.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:57.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:58.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:58.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:58.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:58.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:59.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:35:59.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:35:59.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:35:59.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:00.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:00.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:00.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:00.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:01.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:01.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:01.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:01.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:02.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:02.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:02.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:02.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:03.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:03.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:03.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:03.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:04.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:04.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:04.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:04.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:05.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:05.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:05.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:05.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:06.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:06.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:06.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:06.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:07.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:07.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:07.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:07.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:08.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:08.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:08.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:08.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:09.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:09.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:09.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:09.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:10.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:10.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:10.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:10.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:11.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:11.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:11.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:11.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:12.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:12.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:12.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:12.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:13.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:13.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:13.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:13.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:14.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:14.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:14.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:14.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:15.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:15.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:15.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:15.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:16.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:16.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:16.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:16.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:17.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:17.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:17.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:17.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:18.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:18.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:18.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:18.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:19.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:19.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:19.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:19.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:20.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:20.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:20.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:20.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:21.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:21.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:21.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:21.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:22.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:22.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:22.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:22.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:23.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:23.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:23.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:23.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:24.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:24.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:24.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:24.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:25.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:25.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:25.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:25.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:26.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:26.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:26.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:26.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:27.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:27.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:27.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:27.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:28.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:28.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:28.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:28.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:29.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:29.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:29.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:29.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:30.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:30.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:30.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:30.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:31.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:31.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:31.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:31.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:32.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:32.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:32.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:32.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:33.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:33.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:33.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:33.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:34.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:34.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:34.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:34.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:35.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:35.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:35.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:35.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:36.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:36.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:36.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:36.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:37.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:37.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:37.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:37.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:38.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:38.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:38.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:38.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:39.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:39.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:39.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:39.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:40.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:40.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:40.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:40.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:41.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:41.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:41.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:41.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:42.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:42.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:42.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:42.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:43.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:43.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:43.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:43.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:44.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:44.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:44.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:44.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:45.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:45.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:45.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:45.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:46.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:46.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:46.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:46.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:47.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:47.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:47.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:47.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:48.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:48.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:48.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:48.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:49.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:49.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:49.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:49.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:50.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:50.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:50.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:50.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:51.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:51.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:51.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:51.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:52.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:52.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:52.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:52.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:53.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:53.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:53.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:53.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:54.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:54.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:54.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:54.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:55.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:55.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:55.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:55.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:56.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:56.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:56.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:56.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:57.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:57.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:57.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:57.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:58.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:58.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:58.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:58.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:59.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:36:59.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:36:59.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:36:59.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:00.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:00.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:00.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:00.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:01.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:01.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:01.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:01.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:02.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:02.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:02.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:02.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:03.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:03.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:03.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:03.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:04.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:04.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:04.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:04.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:05.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:05.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:05.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:05.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:06.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:06.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:06.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:06.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:07.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:07.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:07.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:07.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:08.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:08.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:08.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:08.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:09.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:09.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:09.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:09.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:10.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:10.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:10.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:10.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:11.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:11.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:11.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:11.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:12.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:12.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:12.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:12.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:13.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:13.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:13.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:13.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:14.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:14.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:14.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:14.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:15.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:15.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:15.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:15.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:16.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:16.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:16.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:16.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:17.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:17.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:17.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:17.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:18.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:18.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:18.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:18.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:19.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:19.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:19.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:19.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:20.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:20.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:20.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:20.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:21.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:21.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:21.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:21.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:22.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:22.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:23.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:23.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:23.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:23.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:24.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:24.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:24.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:24.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:25.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:25.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:25.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:25.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:26.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:26.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:26.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:26.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:27.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:27.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:27.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:27.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:28.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:28.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:28.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:28.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:29.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:29.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:29.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:29.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:30.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:30.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:30.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:30.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:31.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:31.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:31.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:31.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:32.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:32.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:32.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:32.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:33.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:33.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:33.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:33.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:34.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:34.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:34.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:34.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:35.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:35.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:35.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:35.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:36.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:36.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:36.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:36.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:37.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:37.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:37.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:37.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:38.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:38.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:38.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:38.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:39.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:39.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:39.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:39.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:40.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:40.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:40.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:40.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:41.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:41.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:41.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:41.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:42.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:42.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:42.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:42.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:43.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:43.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:43.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:43.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:44.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:44.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:44.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:44.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:45.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:45.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:45.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:45.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:46.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:46.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:46.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:46.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:47.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:47.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:47.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:47.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:48.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:48.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:48.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:48.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:49.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:49.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:49.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:49.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:50.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:50.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:50.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:50.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:51.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:51.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:51.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:51.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:52.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:52.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:52.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:52.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:53.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:53.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:53.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:53.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:54.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:54.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:54.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:54.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:55.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:55.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:55.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:55.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:56.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:56.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:56.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:56.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:57.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:57.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:57.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:57.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:58.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:58.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:58.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:58.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:59.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:37:59.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:37:59.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:37:59.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:00.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:00.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:00.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:00.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:01.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:01.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:01.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:01.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:02.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:02.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:02.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:02.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:03.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:03.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:03.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:03.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:04.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:04.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:04.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:04.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:05.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:05.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:05.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:05.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:06.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:06.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:06.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:06.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:07.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:07.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:07.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:07.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:08.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:08.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:08.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:08.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:09.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:09.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:09.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:09.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:10.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:10.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:10.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:10.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:11.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:11.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:11.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:11.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:12.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:12.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:12.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:12.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:13.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:13.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:13.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:13.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:14.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:14.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:14.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:14.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:15.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:15.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:15.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:15.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:16.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:16.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:16.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:16.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:17.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:17.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:17.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:17.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:18.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:18.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:18.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:18.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:19.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:19.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:19.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:19.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:20.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:20.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:20.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:20.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:21.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:21.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:21.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:21.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:21.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:21.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:22.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:22.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:22.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:22.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:23.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:23.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:23.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:23.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:24.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:24.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:24.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:24.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:25.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:25.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:25.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:25.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:26.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:26.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:26.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:26.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:27.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:27.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:27.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:27.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:28.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:28.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:28.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:28.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:29.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:29.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:29.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:29.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:30.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:30.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:30.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:30.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:31.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:31.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:31.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:31.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:32.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:32.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:32.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:32.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:33.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:33.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:33.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:33.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:34.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:34.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:34.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:34.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:35.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:35.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:35.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:35.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:36.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:36.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:36.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:36.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:37.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:37.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:37.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:37.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:38.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:38.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:38.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:38.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:39.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:39.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:39.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:39.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:40.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:40.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:40.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:40.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:41.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:41.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:41.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:41.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:42.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:42.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:42.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:42.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:43.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:43.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:43.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:43.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:44.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:44.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:44.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:44.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:45.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:45.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:45.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:45.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:46.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:46.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:46.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:46.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:47.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:47.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:47.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:47.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:48.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:48.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:48.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:48.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:49.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:49.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:49.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:49.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:50.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:50.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:50.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:50.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:51.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:51.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:51.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:51.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:52.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:52.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:52.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:52.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:53.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:53.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:53.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:53.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:54.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:54.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:54.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:54.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:55.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:55.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:55.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:55.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:56.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:56.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:56.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:56.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:57.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:57.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:57.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:57.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:58.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:58.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:58.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:58.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:59.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:38:59.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:38:59.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:38:59.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:00.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:00.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:00.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:00.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:01.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:01.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:01.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:01.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:02.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:02.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:02.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:02.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:03.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:03.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:03.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:03.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:04.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:04.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:04.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:04.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:05.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:05.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:05.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:05.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:06.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:06.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:06.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:06.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:07.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:07.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:07.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:07.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:08.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:08.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:09.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:09.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:09.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:09.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:10.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:10.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:10.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:10.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:11.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:11.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:11.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:11.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:12.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:12.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:12.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:12.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:13.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:13.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:13.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:13.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:14.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:14.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:14.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:14.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:14.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:14.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:15.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:15.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:15.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:15.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:16.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:16.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:16.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:16.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:17.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:17.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:17.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:17.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:18.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:18.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:18.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:18.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:19.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:19.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:19.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:19.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:20.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:20.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:21.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:21.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:21.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:21.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:22.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:22.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:22.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:22.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:23.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:23.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:23.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:23.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:24.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:24.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:24.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:24.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:25.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:25.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:25.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:25.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:26.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:25.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:26.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:26.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:26.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:26.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:27.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:27.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:27.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:27.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:28.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:28.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:28.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:28.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:29.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:29.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:29.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:29.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:30.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:30.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:31.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:31.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:31.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:31.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:32.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:32.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:32.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:32.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:33.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:33.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:33.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:33.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:33.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:33.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:34.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:34.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:35.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:35.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:35.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:35.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:35.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:35.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:36.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:36.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:37.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:37.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:37.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:37.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:38.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:37.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:38.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:38.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:38.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:38.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:39.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:39.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:39.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:39.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:40.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:40.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:40.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:40.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:41.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:41.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:41.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:41.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:42.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:42.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:42.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:42.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:43.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:43.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:43.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:43.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:44.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:44.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:44.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:44.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:45.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:45.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:45.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:45.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:46.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:46.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:46.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:46.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:47.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:47.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:47.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:47.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:48.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:48.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:48.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:48.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:49.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:49.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:50.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:50.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:50.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:50.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:51.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:51.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:51.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:51.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:52.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:52.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:52.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:52.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:53.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:53.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:53.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:53.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:54.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:54.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:54.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:54.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:55.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:55.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:55.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:55.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:56.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:55.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:56.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:56.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:57.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:57.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:57.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:57.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:58.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:58.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:58.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:58.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:59.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:39:59.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:39:59.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:39:59.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:00.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:00.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:00.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:00.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:01.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:01.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:01.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:01.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:02.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:02.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:02.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:02.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:03.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:03.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:03.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:03.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:04.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:04.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:04.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:04.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:05.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:05.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:05.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:05.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:06.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:06.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:06.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:06.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:07.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:07.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:07.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:07.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:08.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:08.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:08.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:08.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:09.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:09.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:09.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:09.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:10.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:10.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:10.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:10.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:11.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:11.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:11.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:11.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:12.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:12.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:12.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:12.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:13.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:13.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:13.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:13.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:14.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:14.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:14.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:14.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:15.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:15.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:15.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:15.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:16.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:16.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:16.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:16.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:17.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:17.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:17.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:17.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:18.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:18.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:18.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:18.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:19.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:19.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:19.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:19.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:20.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:20.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:20.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:20.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:21.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:21.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:21.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:21.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:22.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:22.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:22.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:22.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:23.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:23.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:23.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:23.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:24.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:24.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:24.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:24.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:25.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:25.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:25.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:25.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:26.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:26.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:26.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:26.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:27.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:27.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:27.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:27.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:28.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:28.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:28.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:28.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:29.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:29.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:29.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:29.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:30.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:30.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:30.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:30.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:31.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:31.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:31.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:31.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:32.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:32.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:32.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:32.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:33.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:33.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:33.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:33.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:34.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:34.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:34.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:34.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:35.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:35.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:35.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:35.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:36.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:36.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:36.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:36.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:37.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:37.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:37.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:37.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:38.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:38.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:38.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:38.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:39.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:39.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:39.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:39.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:40.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:40.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:40.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:40.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:41.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:41.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:41.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:41.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:42.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:42.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:42.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:42.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:43.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:43.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:43.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:43.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:44.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:44.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:44.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:44.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:45.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:45.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:45.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:45.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:46.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:46.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:46.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:46.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:47.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:47.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:47.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:47.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:48.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:48.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:48.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:48.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:49.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:49.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:49.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:49.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:50.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:50.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:50.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:50.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:51.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:51.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:51.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:51.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:52.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:52.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:52.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:52.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:53.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:53.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:53.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:53.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:54.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:54.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:54.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:54.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:55.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:55.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:55.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:55.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:56.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:56.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:56.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:56.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:57.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:57.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:57.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:57.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:58.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:58.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:58.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:58.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:59.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:40:59.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:40:59.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:40:59.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:00.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:00.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:00.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:00.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:01.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:01.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:01.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:01.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:02.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:02.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:02.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:02.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:03.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:03.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:03.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:03.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:04.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:04.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:04.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:04.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:05.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:05.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:05.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:05.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:06.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:06.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:06.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:06.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:07.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:07.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:07.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:07.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:08.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:08.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:08.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:08.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:09.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:09.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:09.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:09.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:10.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:10.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:10.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:10.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:11.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:11.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:11.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:11.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:12.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:12.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:12.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:12.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:13.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:13.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:13.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:13.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:14.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:14.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:14.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:14.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:15.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:15.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:15.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:15.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:16.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:16.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:16.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:16.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:17.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:17.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:17.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:17.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:18.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:18.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:18.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:18.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:19.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:19.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:19.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:19.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:20.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:20.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:20.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:20.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:21.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:21.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:21.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:21.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:22.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:22.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:22.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:22.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:23.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:23.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:23.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:23.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:24.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:24.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:24.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:24.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:25.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:25.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:25.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:25.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:26.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:26.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:26.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:26.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:27.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:27.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:27.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:27.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:28.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:28.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:28.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:28.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:29.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:29.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:29.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:29.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:30.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:30.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:30.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:30.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:31.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:31.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:31.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:31.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:32.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:32.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:32.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:32.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:33.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:33.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:33.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:33.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:34.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:34.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:34.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:34.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:35.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:35.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:35.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:35.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:36.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:36.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:36.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:36.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:37.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:37.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:37.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:37.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:38.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:38.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:38.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:38.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:39.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:39.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:39.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:39.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:40.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:40.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:40.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:40.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:41.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:41.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:41.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:41.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:42.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:42.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:42.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:42.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:43.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:43.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:43.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:43.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:44.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:44.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:44.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:44.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:45.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:45.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:45.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:45.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:46.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:46.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:46.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:46.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:47.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:47.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:47.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:47.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:48.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:48.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:48.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:48.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:49.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:49.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:49.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:49.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:50.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:50.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:50.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:50.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:51.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:51.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:51.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:51.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:52.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:52.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:52.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:52.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:53.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:53.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:53.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:53.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:54.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:54.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:54.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:54.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:55.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:55.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:55.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:55.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:56.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:56.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:56.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:56.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:57.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:57.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:57.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:57.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:58.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:58.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:58.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:58.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:59.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:41:59.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:41:59.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:41:59.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:00.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:00.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:00.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:00.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:01.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:01.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:01.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:01.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:02.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:02.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:02.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:02.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:03.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:03.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:03.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:03.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:04.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:04.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:04.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:04.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:05.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:05.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:05.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:05.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:06.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:06.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:06.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:06.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:07.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:07.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:07.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:07.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:08.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:08.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:08.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:08.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:09.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:09.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:09.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:09.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:10.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:10.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:10.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:10.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:11.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:11.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:11.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:11.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:12.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:12.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:12.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:12.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:13.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:13.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:13.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:13.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:14.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:14.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:14.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:14.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:15.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:15.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:15.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:15.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:16.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:16.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:16.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:16.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:17.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:17.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:17.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:17.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:18.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:18.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:18.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:18.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:19.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:19.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:19.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:19.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:20.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:20.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:20.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:20.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:21.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:21.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:21.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:21.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:22.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:22.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:22.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:22.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:23.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:23.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:23.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:23.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:24.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:24.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:24.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:24.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:25.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:25.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:25.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:25.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:26.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:26.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:26.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:26.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:27.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:27.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:27.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:27.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:28.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:28.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:28.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:28.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:29.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:29.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:29.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:29.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:30.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:30.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:30.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:30.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:31.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:31.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:31.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:31.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:32.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:32.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:32.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:32.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:33.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:33.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:33.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:33.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:34.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:34.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:34.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:34.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:35.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:35.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:35.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:35.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:36.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:36.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:36.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:36.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:37.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:37.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:37.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:37.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:38.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:38.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:38.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:38.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:39.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:39.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:39.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:39.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:40.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:40.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:40.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:40.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:41.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:41.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:41.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:41.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:42.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:42.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:42.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:42.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:43.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:43.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:43.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:43.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:44.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:44.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:44.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:44.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:45.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:45.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:45.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:45.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:46.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:46.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:46.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:46.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:47.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:47.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:47.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:47.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:48.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:48.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:48.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:48.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:49.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:49.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:49.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:49.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:50.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:50.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:50.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:50.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:51.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:51.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:51.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:51.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:52.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:52.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:52.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:52.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:53.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:53.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:53.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:53.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:54.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:54.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:54.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:54.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:55.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:55.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:55.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:55.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:56.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:56.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:56.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:56.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:57.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:57.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:57.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:57.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:58.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:58.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:58.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:58.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:59.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:42:59.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:42:59.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:42:59.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:00.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:00.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:00.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:00.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:01.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:01.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:01.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:01.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:02.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:02.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:02.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:02.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:03.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:03.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:03.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:03.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:04.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:04.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:04.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:04.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:05.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:05.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:05.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:05.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:06.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:06.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:06.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:06.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:06.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:06.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:07.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:07.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:08.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:08.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:08.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:08.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:09.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:09.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:09.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:09.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:10.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:10.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:10.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:10.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:11.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:11.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:11.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:11.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:12.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:12.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:12.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:12.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:13.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:13.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:13.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:13.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:14.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:14.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:14.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:14.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:15.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:15.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:15.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:15.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:16.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:16.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:16.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:16.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:17.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:17.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:17.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:17.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:18.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:18.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:18.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:18.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:19.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:19.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:19.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:19.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:20.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:20.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:20.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:20.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:21.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:21.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:21.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:21.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:22.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:22.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:22.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:22.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:23.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:23.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:23.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:23.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:24.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:24.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:24.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:24.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:25.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:25.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:25.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:25.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:26.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:26.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:26.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:26.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:27.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:27.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:27.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:27.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:28.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:28.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:28.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:28.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:29.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:29.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:29.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:29.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:30.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:30.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:30.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:30.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:31.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:31.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:31.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:31.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:32.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:32.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:32.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:32.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:33.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:33.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:33.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:33.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:34.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:34.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:34.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:34.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:35.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:35.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:35.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:35.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:36.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:36.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:36.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:36.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:37.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:37.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:37.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:37.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:38.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:38.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:38.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:38.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:39.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:39.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:39.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:39.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:40.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:40.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:40.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:40.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:41.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:41.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:41.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:41.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:42.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:42.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:42.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:42.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:43.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:43.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:43.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:43.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:44.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:44.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:44.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:44.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:45.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:45.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:45.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:45.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:46.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:46.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:46.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:46.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:47.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:47.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:47.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:47.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:48.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:48.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:48.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:48.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:49.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:49.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:49.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:49.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:50.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:50.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:50.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:50.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:51.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:51.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:51.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:51.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:52.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:52.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:52.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:52.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:53.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:53.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:53.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:53.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:54.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:54.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:54.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:54.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:55.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:55.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:55.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:55.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:56.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:56.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:56.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:56.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:57.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:57.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:57.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:57.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:58.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:58.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:58.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:58.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:59.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:43:59.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:43:59.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:43:59.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:00.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:00.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:00.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:00.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:01.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:01.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:01.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:01.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:02.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:02.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:02.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:02.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:03.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:03.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:03.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:03.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:04.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:04.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:04.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:04.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:05.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:05.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:05.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:05.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:06.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:06.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:06.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:06.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:07.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:07.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:07.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:07.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:08.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:08.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:08.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:08.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:09.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:09.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:09.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:09.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:10.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:10.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:10.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:10.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:11.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:11.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:11.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:11.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:12.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:12.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:12.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:12.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:13.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:13.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:13.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:13.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:14.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:14.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:14.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:14.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:15.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:15.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:15.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:15.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:16.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:16.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:16.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:16.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:17.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:17.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:17.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:17.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:18.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:18.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:18.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:18.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:19.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:19.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:19.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:19.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:20.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:20.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:20.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:20.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:21.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:21.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:21.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:21.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:22.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:22.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:22.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:22.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:23.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:23.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:23.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:23.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:24.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:24.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:24.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:24.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:25.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:25.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:25.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:25.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:26.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:26.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:26.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:26.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:27.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:27.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:27.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:27.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:28.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:28.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:28.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:28.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:29.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:29.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:29.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:29.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:30.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:30.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:30.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:30.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:31.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:31.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:31.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:31.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:32.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:32.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:32.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:32.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:33.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:33.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:33.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:33.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:34.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:33.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:34.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:34.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:35.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:35.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:35.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:35.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:36.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:36.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:36.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:36.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:37.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:37.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:37.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:37.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:38.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:38.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:38.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:38.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:39.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:39.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:39.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:39.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:40.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:40.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:40.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:40.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:41.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:41.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:41.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:41.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:42.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:42.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:42.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:42.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:43.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:43.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:43.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:43.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:44.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:44.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:44.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:44.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:45.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:45.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:45.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:45.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:46.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:46.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:46.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:46.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:47.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:47.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:47.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:47.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:48.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:48.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:48.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:48.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:49.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:49.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:49.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:49.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:50.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:50.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:50.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:50.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:51.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:51.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:51.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:51.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:52.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:52.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:52.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:52.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:53.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:53.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:53.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:53.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:54.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:54.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:54.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:54.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:55.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:55.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:55.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:55.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:56.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:56.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:56.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:56.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:57.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:57.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:57.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:57.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:58.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:58.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:58.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:58.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:59.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:44:59.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:44:59.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:44:59.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:00.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:00.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:00.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:00.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:01.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:01.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:01.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:01.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:02.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:02.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:02.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:02.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:03.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:03.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:03.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:03.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:04.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:04.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:04.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:04.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:05.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:05.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:05.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:05.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:06.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:06.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:06.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:06.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:07.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:07.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:07.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:07.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:08.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:08.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:08.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:08.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:09.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:09.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:09.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:09.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:10.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:10.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:10.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:10.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:11.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:11.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:11.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:11.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:12.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:12.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:12.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:12.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:13.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:13.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:13.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:13.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:14.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:14.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:14.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:14.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:15.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:15.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:15.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:15.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:16.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:16.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:16.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:16.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:17.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:17.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:17.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:17.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:18.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:18.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:18.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:18.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:19.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:19.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:19.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:19.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:20.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:20.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:20.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:20.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:21.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:21.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:21.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:21.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:22.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:22.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:22.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:22.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:23.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:23.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:23.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:23.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:24.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:24.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:24.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:24.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:25.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:25.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:25.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:25.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:26.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:26.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:26.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:26.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:27.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:27.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:27.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:27.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:28.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:28.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:28.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:28.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:29.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:29.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:29.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:29.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:30.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:30.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:30.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:30.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:31.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:31.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:31.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:31.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:32.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:32.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:32.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:32.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:33.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:33.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:33.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:33.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:34.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:34.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:34.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:34.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:35.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:35.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:35.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:35.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:36.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:36.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:36.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:36.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:37.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:37.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:37.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:37.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:38.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:38.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:38.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:38.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:39.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:39.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:39.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:39.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:40.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:40.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:40.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:40.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:41.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:41.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:41.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:41.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:42.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:42.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:42.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:42.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:43.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:43.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:43.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:43.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:44.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:44.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:44.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:44.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:45.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:45.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:45.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:45.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:46.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:46.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:46.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:46.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:47.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:47.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:47.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:47.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:48.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:48.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:48.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:48.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:49.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:49.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:49.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:49.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:50.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:50.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:50.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:50.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:51.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:51.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:51.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:51.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:52.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:52.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:52.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:52.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:53.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:53.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:53.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:53.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:54.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:54.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:54.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:54.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:55.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:55.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:55.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:55.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:56.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:56.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:56.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:56.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:57.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:57.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:57.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:57.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:58.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:58.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:58.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:58.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:59.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:45:59.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:45:59.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:45:59.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:00.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:00.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:00.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:00.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:01.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:01.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:01.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:01.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:02.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:02.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:02.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:02.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:03.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:03.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:03.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:03.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:04.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:04.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:04.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:04.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:05.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:05.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:05.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:05.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:06.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:06.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:06.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:06.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:07.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:07.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:07.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:07.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:08.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:08.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:08.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:08.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:09.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:09.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:09.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:09.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:10.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:10.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:10.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:10.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:11.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:11.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:11.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:11.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:12.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:12.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:12.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:12.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:13.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:13.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:13.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:13.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:14.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:14.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:14.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:14.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:15.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:15.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:15.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:15.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:16.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:16.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:16.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:16.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:17.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:17.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:17.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:17.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:18.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:18.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:18.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:18.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:19.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:19.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:19.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:19.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:20.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:20.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:20.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:20.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:21.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:21.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:21.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:21.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:22.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:22.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:22.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:22.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:23.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:23.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:23.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:23.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:24.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:24.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:24.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:24.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:25.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:25.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:25.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:25.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:26.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:26.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:26.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:26.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:27.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:27.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:27.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:27.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:28.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:28.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:28.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:28.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:29.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:29.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:29.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:29.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:30.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:30.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:30.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:30.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:31.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:31.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:31.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:31.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:32.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:32.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:32.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:32.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:33.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:33.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:33.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:33.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:34.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:34.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:34.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:34.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:35.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:35.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:35.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:35.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:36.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:36.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:36.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:36.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:37.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:37.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:37.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:37.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:38.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:38.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:38.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:39.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:39.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:39.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:39.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:40.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:40.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:40.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:40.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:41.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:41.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:41.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:41.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:42.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:42.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:42.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:42.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:43.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:43.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:43.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:43.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:44.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:44.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:44.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:44.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:45.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:45.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:45.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:45.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:46.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:46.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:46.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:46.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:47.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:47.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:47.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:47.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:48.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:48.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:48.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:48.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:49.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:49.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:49.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:49.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:49.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:49.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:50.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:50.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:50.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:50.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:51.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:51.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:51.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:51.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:52.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:52.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:52.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:52.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:53.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:53.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:53.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:53.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:54.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:54.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:54.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:54.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:55.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:55.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:55.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:55.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:56.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:56.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:56.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:56.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:57.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:57.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:57.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:57.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:58.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:58.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:58.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:58.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:59.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:46:59.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:46:59.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:46:59.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:00.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:00.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:00.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:00.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:01.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:01.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:01.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:01.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:02.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:02.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:02.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:02.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:03.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:03.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:03.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:03.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:04.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:04.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:04.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:04.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:05.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:05.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:05.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:05.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:06.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:06.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:06.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:06.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:07.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:07.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:07.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:07.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:08.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:08.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:08.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:08.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:09.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:09.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:09.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:09.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:10.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:10.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:10.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:10.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:11.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:11.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:11.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:11.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:12.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:12.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:13.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:13.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:13.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:13.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:13.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:13.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:14.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:14.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:14.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:14.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:15.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:15.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:15.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:15.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:16.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:16.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:16.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:16.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:17.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:17.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:17.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:17.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:18.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:18.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:18.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:18.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:19.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:19.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:19.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:19.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:20.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:20.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:20.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:20.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:21.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:21.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:21.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:21.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:22.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:22.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:23.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:23.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:23.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:23.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:23.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:23.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:24.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:24.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:24.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:24.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:25.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:25.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:26.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:25.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:26.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:26.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:27.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:27.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:27.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:27.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:27.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:27.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:28.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:28.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:28.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:28.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:29.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:29.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:29.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:29.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:30.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:30.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:30.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:30.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:31.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:31.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:31.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:31.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:32.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:32.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:32.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:32.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:33.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:33.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:33.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:33.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:34.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:34.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:34.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:34.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:35.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:35.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:36.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:36.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:37.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:36.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:37.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:36.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:37.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:37.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:38.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:38.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:38.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:38.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:38.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:38.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:39.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:39.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:40.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:40.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:40.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:40.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:40.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:40.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:42.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:42.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:42.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:42.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:43.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:43.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:43.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:43.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:44.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:44.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:44.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:44.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:45.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:45.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:45.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:45.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:46.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:46.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:46.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:46.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:47.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:47.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:47.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:47.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:48.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:48.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:48.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:48.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:49.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:49.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:49.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:49.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:50.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:50.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:50.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:50.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:51.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:51.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:51.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:51.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:52.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:52.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:52.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:52.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:53.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:53.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:53.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:53.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:54.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:54.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:54.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:54.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:55.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:55.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:55.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:55.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:56.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:56.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:56.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:56.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:57.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:57.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:57.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:57.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:58.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:58.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:58.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:58.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:59.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:59.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:59.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:47:59.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:47:59.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:47:59.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:00.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:00.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:00.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:00.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:01.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:01.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:01.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:01.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:02.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:02.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:02.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:02.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:03.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:03.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:03.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:03.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:04.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:04.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:04.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:04.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:05.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:05.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:05.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:05.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:06.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:06.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:06.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:06.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:07.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:07.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:07.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:07.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:08.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:08.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:08.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:08.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:09.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:09.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:09.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:09.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:10.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:10.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:10.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:10.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:11.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:11.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:11.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:11.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:12.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:12.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:12.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:12.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:13.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:13.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:13.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:13.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:14.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:14.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:14.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:14.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:15.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:15.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:15.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:15.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:16.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:16.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:16.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:16.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:17.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:17.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:17.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:17.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:18.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:18.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:18.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:18.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:19.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:19.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:19.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:19.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:20.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:20.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:20.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:20.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:21.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:21.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:21.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:21.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:22.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:22.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:22.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:22.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:23.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:23.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:23.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:23.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:24.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:24.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:24.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:24.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:25.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:25.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:25.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:25.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:26.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:26.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:26.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:26.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:27.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:27.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:27.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:27.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:28.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:28.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:28.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:28.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:29.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:29.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:29.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:29.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:30.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:30.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:30.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:30.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:31.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:31.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:31.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:31.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:32.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:32.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:32.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:32.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:33.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:33.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:33.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:33.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:34.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:34.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:34.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:34.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:35.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:35.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:35.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:35.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:36.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:36.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:36.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:36.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:37.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:37.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:37.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:37.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:37.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:37.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:38.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:38.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:38.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:38.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:39.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:39.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:39.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:39.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:40.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:40.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:40.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:40.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:41.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:41.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:41.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:41.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:42.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:42.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:42.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:42.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:43.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:43.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:43.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:43.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:44.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:44.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:44.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:44.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:45.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:45.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:45.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:45.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:46.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:46.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:46.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:46.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:47.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:47.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:48.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:48.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:48.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:48.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:49.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:49.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:49.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:49.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:50.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:50.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:50.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:50.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:50.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:50.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:51.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:51.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:52.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:52.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:52.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:52.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:53.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:53.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:53.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:53.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:54.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:54.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:54.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:54.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:55.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:55.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:55.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:55.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:56.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:56.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:57.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:57.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:57.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:57.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:58.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:58.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:58.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:58.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:59.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:48:59.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:48:59.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:48:59.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:00.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:00.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:00.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:00.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:01.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:01.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:01.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:01.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:02.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:02.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:02.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:02.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:03.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:03.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:03.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:03.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:04.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:04.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:04.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:04.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:05.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:05.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:05.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:05.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:06.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:06.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:06.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:06.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:07.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:07.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:07.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:07.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:08.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:08.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:08.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:08.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:09.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:09.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:09.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:09.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:10.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:10.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:10.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:10.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:11.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:11.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:11.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:11.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:12.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:12.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:12.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:12.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:13.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:13.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:13.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:13.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:14.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:14.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:14.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:14.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:15.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:15.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:15.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:15.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:16.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:16.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:16.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:16.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:17.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:17.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:17.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:17.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:18.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:18.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:18.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:18.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:19.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:19.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:19.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:19.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:20.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:20.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:20.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:20.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:21.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:21.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:21.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:21.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:22.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:22.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:22.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:22.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:23.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:23.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:23.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:23.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:24.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:24.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:24.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:24.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:25.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:25.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:25.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:25.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:26.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:26.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:26.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:26.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:27.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:27.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:27.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:27.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:28.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:28.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:28.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:28.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:29.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:29.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:29.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:29.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:30.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:30.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:30.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:30.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:31.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:31.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:31.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:31.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:32.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:32.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:32.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:32.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:33.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:33.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:33.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:33.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:34.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:34.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:34.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:34.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:35.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:35.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:35.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:35.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:36.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:36.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:36.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:36.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:37.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:37.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:37.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:37.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:38.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:38.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:38.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:38.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:39.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:39.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:39.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:39.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:40.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:40.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:40.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:40.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:41.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:41.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:41.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:41.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:42.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:42.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:42.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:42.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:43.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:43.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:43.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:43.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:44.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:44.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:44.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:44.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:45.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:45.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:45.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:45.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:46.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:46.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:46.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:46.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:47.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:47.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:47.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:47.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:48.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:48.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:48.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:48.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:49.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:49.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:49.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:49.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:50.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:50.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:50.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:50.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:51.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:51.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:51.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:51.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:52.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:52.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:52.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:52.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:53.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:53.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:53.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:53.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:54.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:54.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:54.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:54.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:55.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:55.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:55.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:55.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:56.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:56.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:56.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:56.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:57.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:57.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:57.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:57.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:58.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:58.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:58.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:58.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:59.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:49:59.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:49:59.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:49:59.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:00.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:00.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:00.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:00.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:01.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:01.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:01.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:01.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:02.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:02.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:02.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:02.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:03.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:03.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:03.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:03.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:04.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:04.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:04.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:04.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:05.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:05.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:05.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:05.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:06.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:06.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:06.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:06.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:07.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:07.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:07.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:07.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:08.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:08.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:08.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:08.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:09.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:09.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:09.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:09.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:10.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:10.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:10.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:10.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:11.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:11.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:11.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:11.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:12.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:12.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:12.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:12.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:13.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:13.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:13.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:13.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:14.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:14.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:14.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:14.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:15.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:15.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:15.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:15.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:16.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:16.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:16.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:16.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:17.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:17.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:17.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:17.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:18.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:18.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:18.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:18.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:19.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:19.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:19.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:19.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:20.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:20.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:20.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:20.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:21.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:21.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:21.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:21.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:22.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:22.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:22.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:22.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:23.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:23.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:23.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:23.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:24.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:24.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:24.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:24.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:25.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:25.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:25.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:25.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:26.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:26.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:26.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:26.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:27.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:27.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:27.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:27.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:28.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:28.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:28.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:28.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:29.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:29.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:29.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:29.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:30.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:30.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:30.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:30.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:31.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:31.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:31.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:31.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:32.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:32.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:32.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:32.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:33.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:33.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:33.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:33.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:34.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:34.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:34.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:34.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:35.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:35.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:35.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:35.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:36.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:36.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:36.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:36.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:37.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:37.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:37.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:37.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:38.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:38.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:38.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:38.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:39.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:39.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:39.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:39.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:40.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:40.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:40.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:40.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:41.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:41.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:41.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:41.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:42.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:42.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:42.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:42.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:43.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:43.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:43.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:43.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:44.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:44.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:44.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:44.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:45.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:45.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:45.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:45.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:46.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:46.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:46.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:46.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:47.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:47.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:47.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:47.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:48.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:48.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:48.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:48.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:49.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:49.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:49.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:49.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:50.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:50.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:50.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:50.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:51.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:51.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:51.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:51.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:52.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:52.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:52.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:52.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:53.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:53.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:53.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:53.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:54.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:54.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:54.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:54.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:55.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:55.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:55.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:55.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:56.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:56.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:56.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:56.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:57.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:57.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:57.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:57.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:58.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:58.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:58.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:58.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:59.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:50:59.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:50:59.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:50:59.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:00.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:00.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:00.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:00.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:01.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:01.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:01.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:01.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:02.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:02.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:02.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:02.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:03.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:03.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:03.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:03.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:04.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:04.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:04.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:04.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:05.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:05.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:05.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:05.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:06.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:06.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:06.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:06.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:07.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:07.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:07.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:07.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:08.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:08.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:08.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:08.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:09.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:09.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:09.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:09.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:10.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:10.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:10.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:10.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:11.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:11.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:11.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:11.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:12.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:12.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:12.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:12.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:13.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:13.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:13.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:13.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:14.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:14.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:14.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:14.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:15.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:15.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:15.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:15.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:16.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:16.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:16.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:16.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:17.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:17.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:17.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:17.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:18.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:18.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:18.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:18.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:19.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:19.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:19.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:19.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:20.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:20.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:20.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:20.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:21.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:21.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:21.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:21.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:22.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:22.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:22.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:22.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:23.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:23.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:23.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:23.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:24.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:24.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:24.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:24.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:25.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:25.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:25.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:25.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:26.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:26.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:26.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:26.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:27.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:27.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:27.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:27.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:28.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:28.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:28.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:28.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:29.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:29.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:29.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:29.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:30.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:30.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:30.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:30.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:31.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:31.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:31.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:31.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:32.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:32.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:32.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:32.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:33.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:33.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:33.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:33.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:34.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:34.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:34.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:34.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:35.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:35.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:35.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:35.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:36.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:36.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:36.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:36.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:37.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:37.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:37.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:37.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:38.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:38.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:38.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:38.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:39.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:39.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:39.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:39.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:40.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:40.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:40.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:40.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:41.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:41.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:41.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:41.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:42.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:42.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:42.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:42.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:43.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:43.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:43.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:43.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:44.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:44.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:44.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:44.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:45.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:45.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:45.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:45.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:46.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:46.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:46.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:46.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:47.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:47.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:47.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:47.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:48.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:48.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:48.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:48.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:49.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:49.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:49.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:49.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:50.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:50.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:50.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:50.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:51.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:51.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:51.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:51.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:52.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:52.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:52.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:52.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:53.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:53.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:53.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:53.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:54.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:54.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:54.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:54.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:55.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:55.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:55.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:55.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:56.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:56.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:56.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:56.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:57.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:57.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:57.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:57.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:58.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:58.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:58.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:58.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:59.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:51:59.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:51:59.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:51:59.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:00.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:00.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:00.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:00.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:01.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:01.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:01.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:01.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:02.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:02.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:02.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:02.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:03.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:03.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:03.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:03.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:04.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:04.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:04.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:04.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:05.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:05.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:05.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:05.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:06.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:06.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:06.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:06.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:07.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:07.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:07.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:07.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:08.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:08.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:08.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:08.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:09.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:09.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:09.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:09.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:10.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:10.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:10.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:10.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:11.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:11.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:11.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:11.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:12.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:12.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:12.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:12.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:13.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:13.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:13.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:13.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:14.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:14.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:14.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:14.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:15.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:15.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:15.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:15.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:16.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:16.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:16.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:16.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:17.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:17.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:17.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:17.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:18.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:18.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:18.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:18.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:19.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:19.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:19.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:19.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:20.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:20.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:20.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:20.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:21.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:21.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:21.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:21.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:22.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:22.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:22.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:22.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:23.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:23.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:23.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:23.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:24.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:24.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:24.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:24.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:25.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:25.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:25.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:25.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:26.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:26.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:26.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:26.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:27.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:27.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:27.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:27.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:28.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:28.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:28.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:28.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:29.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:29.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:29.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:29.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:30.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:30.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:30.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:30.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:31.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:31.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:31.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:31.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:32.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:32.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:32.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:32.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:33.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:33.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:33.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:33.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:34.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:34.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:34.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:34.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:35.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:35.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:35.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:35.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:36.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:36.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:36.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:36.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:37.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:37.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:37.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:37.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:38.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:38.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:38.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:38.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:39.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:39.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:39.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:39.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:40.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:40.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:40.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:40.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:41.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:41.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:41.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:41.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:42.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:42.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:42.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:42.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:43.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:43.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:43.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:43.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:44.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:44.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:44.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:44.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:45.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:45.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:45.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:45.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:46.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:46.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:46.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:46.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:47.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:47.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:47.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:47.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:48.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:48.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:48.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:48.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:49.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:49.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:49.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:49.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:50.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:50.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:50.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:50.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:51.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:51.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:51.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:51.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:52.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:52.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:52.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:52.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:53.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:53.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:53.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:53.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:54.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:54.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:54.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:54.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:55.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:55.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:55.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:55.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:56.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:56.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:56.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:56.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:57.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:57.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:57.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:57.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:58.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:58.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:58.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:58.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:59.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:52:59.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:52:59.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:52:59.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:00.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:00.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:00.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:00.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:01.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:01.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:01.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:01.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:02.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:02.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:02.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:02.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:03.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:03.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:03.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:03.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:04.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:04.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:04.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:04.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:05.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:05.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:05.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:05.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:06.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:06.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:06.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:06.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:07.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:07.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:07.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:07.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:08.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:08.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:08.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:08.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:09.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:09.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:09.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:09.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:10.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:10.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:10.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:10.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:11.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:11.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:11.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:11.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:12.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:12.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:12.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:12.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:13.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:13.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:13.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:13.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:14.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:14.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:14.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:14.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:15.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:15.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:15.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:15.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:16.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:16.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:16.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:16.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:17.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:17.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:17.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:17.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:18.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:18.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:18.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:18.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:19.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:19.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:19.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:19.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:20.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:20.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:20.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:20.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:21.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:21.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:21.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:21.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:22.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:22.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:22.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:22.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:23.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:23.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:23.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:23.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:24.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:24.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:24.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:24.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:25.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:25.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:25.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:25.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:26.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:26.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:26.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:26.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:27.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:27.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:27.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:27.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:28.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:28.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:28.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:28.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:29.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:29.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:29.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:29.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:30.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:30.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:30.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:30.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:31.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:31.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:31.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:31.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:32.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:32.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:32.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:32.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:33.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:33.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:33.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:33.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:34.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:34.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:34.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:34.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:35.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:35.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:35.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:35.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:36.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:36.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:36.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:36.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:37.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:37.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:37.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:37.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:38.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:38.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:38.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:38.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:39.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:39.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:39.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:39.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:40.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:40.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:40.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:40.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:41.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:41.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:41.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:41.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:42.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:42.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:42.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:42.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:43.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:43.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:43.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:43.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:44.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:44.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:44.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:44.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:45.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:45.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:45.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:45.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:46.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:46.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:46.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:46.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:47.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:47.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:47.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:47.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:48.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:48.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:48.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:48.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:49.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:49.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:50.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:49.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:51.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:51.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:51.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:51.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:52.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:52.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:52.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:52.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:53.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:53.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:53.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:53.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:54.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:54.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:54.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:54.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:55.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:55.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:55.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:55.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:56.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:56.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:56.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:56.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:57.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:57.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:57.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:57.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:58.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:58.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:58.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:58.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:59.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:53:59.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:53:59.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:53:59.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:00.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:00.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:00.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:00.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:01.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:01.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:01.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:01.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:02.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:02.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:02.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:02.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:03.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:03.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:03.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:03.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:04.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:04.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:04.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:04.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:05.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:05.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:05.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:05.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:06.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:06.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:06.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:06.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:07.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:07.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:07.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:07.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:08.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:08.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:08.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:08.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:09.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:09.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:09.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:09.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:10.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:10.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:10.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:10.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:11.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:11.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:11.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:11.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:12.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:12.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:12.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:12.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:13.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:13.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:13.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:13.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:14.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:14.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:14.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:14.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:15.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:15.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:15.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:15.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:16.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:16.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:16.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:16.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:17.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:17.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:17.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:17.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:18.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:18.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:18.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:18.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:19.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:19.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:19.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:19.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:20.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:20.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:20.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:20.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:21.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:21.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:21.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:21.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:22.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:22.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:22.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:22.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:23.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:23.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:23.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:23.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:24.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:24.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:24.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:24.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:25.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:25.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:25.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:25.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:26.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:26.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:26.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:26.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:27.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:27.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:27.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:27.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:28.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:28.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:28.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:28.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:29.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:29.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:29.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:29.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:30.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:30.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:30.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:30.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:31.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:31.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:31.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:31.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:32.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:32.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:32.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:32.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:32.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:32.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:33.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:33.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:33.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:33.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:34.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:34.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:34.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:34.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:35.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:35.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:36.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:36.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:36.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:36.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:37.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:37.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:37.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:37.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:38.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:38.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:38.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:38.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:39.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:39.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:39.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:39.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:40.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:40.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:40.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:40.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:41.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:41.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:41.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:41.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:42.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:42.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:42.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:42.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:43.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:42.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:43.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:43.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:43.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:43.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:44.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:44.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:44.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:44.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:45.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:45.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:45.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:45.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:46.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:46.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:46.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:46.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:47.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:47.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:47.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:47.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:48.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:48.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:48.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:48.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:49.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:49.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:49.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:49.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:50.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:50.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:50.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:50.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:50.908 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T22:54:50.905+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa8008740 msgr2=0x7f5fa4032ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T22:54:51.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:51.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:51.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:51.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:52.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:52.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:52.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:52.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:53.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:53.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:53.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:53.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:54.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:54.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:54.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:54.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:55.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:55.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:55.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:55.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:56.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:56.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:56.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:56.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:57.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:57.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:57.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:57.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:58.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:58.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:58.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:58.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:59.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:54:59.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:54:59.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:54:59.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:00.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:00.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:00.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:00.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:01.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:01.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:01.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:01.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:02.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:02.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:02.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:02.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:03.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:03.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:03.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:03.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:04.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:04.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:04.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:04.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:05.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:05.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:06.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:06.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:06.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:06.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:07.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:07.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:07.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:07.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:07.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:07.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:08.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:08.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:08.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:08.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:09.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:09.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:10.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:10.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:10.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:10.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:10.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:10.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:11.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:11.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:11.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:11.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:12.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:12.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:12.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:12.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:13.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:13.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:13.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:13.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:14.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:14.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:14.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:14.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:15.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:15.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:15.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:15.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:16.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:16.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:17.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:17.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:17.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:17.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:17.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:17.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:18.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:18.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:18.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:18.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:20.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:20.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:20.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:20.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:21.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:21.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:21.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:21.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:22.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:22.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:22.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:22.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:23.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:23.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:23.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:23.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:23.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:23.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:24.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:24.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:24.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:24.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:25.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:25.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:25.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:25.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:26.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:26.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:26.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:26.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:27.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:27.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:27.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:27.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:28.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:28.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:28.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:28.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:28.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:28.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:29.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:29.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:30.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:30.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:30.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:30.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:31.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:31.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:31.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:31.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:32.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:32.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:32.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:32.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:33.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:33.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:33.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:33.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:34.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:34.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:34.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:34.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:35.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:35.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:35.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:35.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:36.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:36.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:36.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:36.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:37.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:37.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:37.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:37.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:38.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:38.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:38.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:38.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:39.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:39.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:39.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:39.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:40.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:40.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:40.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:40.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:41.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:41.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:41.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:41.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:41.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:41.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:42.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:42.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:43.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:43.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:43.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:43.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:43.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:43.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:44.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:44.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:44.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:44.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:45.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:45.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:45.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:45.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:46.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:46.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:47.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:47.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:47.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:47.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:47.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:47.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:48.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:48.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:49.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:49.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:49.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:49.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:50.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:50.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:50.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:50.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:51.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:51.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:51.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:51.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:52.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:52.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:52.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:52.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:53.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:53.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:54.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:53.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:54.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:54.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:55.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:55.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:55.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:55.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:56.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:56.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:56.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:56.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:57.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:57.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:57.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:57.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:58.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:58.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:58.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:58.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:58.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:58.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:59.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:55:59.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:55:59.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:55:59.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:00.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:00.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:01.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:01.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:01.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:01.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:01.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:01.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:02.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:02.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:02.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:02.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:03.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:03.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:03.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:03.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:04.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:04.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:04.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:04.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:05.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:05.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:05.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:05.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:06.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:06.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:06.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:06.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:07.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:07.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:07.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:07.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:08.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:08.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:08.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:08.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:09.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:09.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:09.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:09.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:10.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:09.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:10.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:10.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:10.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:10.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:11.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:11.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:11.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:11.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:12.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:12.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:12.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:12.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:13.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:13.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:13.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:13.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:14.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:14.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:15.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:15.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:15.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:15.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:16.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:16.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:16.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:16.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:17.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:17.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:17.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:17.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:18.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:18.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:18.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:18.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:19.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:19.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:19.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:19.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:20.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:20.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:20.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:20.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:21.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:21.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:22.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:21.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:22.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:22.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:23.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:23.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:23.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:23.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:24.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:24.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:24.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:24.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:25.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:25.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:25.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:25.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:26.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:26.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:26.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:26.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:26.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:26.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:27.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:27.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:28.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:28.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:28.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:28.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:29.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:29.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:29.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:29.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:30.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:30.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:30.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:30.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:31.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:31.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:31.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:31.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:32.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:32.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:32.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:32.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:33.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:33.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:33.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:33.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:34.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:34.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:34.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:34.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:35.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:35.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:35.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:35.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:36.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:36.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:36.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:36.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:37.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:37.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:37.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:37.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:38.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:38.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:38.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:38.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:39.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:39.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:39.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:39.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:40.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:40.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:40.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:40.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:41.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:41.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:41.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:41.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:42.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:42.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:42.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:42.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:43.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:43.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:43.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:43.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:44.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:44.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:44.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:44.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:45.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:45.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:45.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:45.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:46.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:46.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:46.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:46.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:47.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:47.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:47.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:47.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:48.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:48.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:48.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:48.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:49.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:49.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:49.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:49.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:50.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:50.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:50.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:50.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:51.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:51.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:51.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:51.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:52.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:52.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:52.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:52.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:53.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:53.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:53.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:53.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:54.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:54.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:54.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:55.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:55.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:55.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:55.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:56.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:56.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:56.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:56.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:57.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:57.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:57.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:57.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:58.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:58.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:58.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:58.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:59.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:56:59.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:56:59.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:56:59.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:00.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:00.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:00.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:00.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:01.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:01.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:01.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:01.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:02.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:02.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:02.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:02.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:03.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:03.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:03.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:03.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:04.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:04.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:04.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:04.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:05.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:05.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:05.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:05.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:06.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:06.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:06.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:06.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:07.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:07.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:07.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:07.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:08.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:08.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:08.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:08.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:09.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:09.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:09.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:09.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:10.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:10.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:10.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:10.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:11.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:11.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:11.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:11.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:12.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:12.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:12.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:12.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:13.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:13.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:13.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:13.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:14.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:14.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:14.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:14.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:15.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:15.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:15.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:15.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:16.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:16.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:16.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:16.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:17.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:17.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:17.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:17.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:18.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:18.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:18.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:18.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:19.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:19.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:19.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:19.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:20.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:20.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:20.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:20.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:21.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:21.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:21.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:21.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:22.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:22.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:22.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:22.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:23.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:23.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:23.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:23.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:24.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:24.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:24.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:24.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:25.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:25.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:25.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:25.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:26.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:26.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:26.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:26.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:27.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:27.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:27.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:27.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:28.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:28.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:28.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:28.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:29.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:29.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:29.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:29.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:30.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:30.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:30.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:30.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:31.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:31.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:31.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:31.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:32.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:32.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:32.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:32.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:33.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:33.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:33.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:33.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:34.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:34.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:34.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:34.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:35.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:35.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:35.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:35.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:36.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:36.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:36.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:36.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:37.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:37.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:37.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:37.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:38.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:38.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:38.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:38.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:39.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:39.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:39.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:39.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:40.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:40.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:40.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:40.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:41.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:41.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:41.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:41.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:42.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:42.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:42.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:42.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:43.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:43.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:43.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:43.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:44.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:44.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:44.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:44.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:45.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:45.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:45.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:45.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:46.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:46.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:46.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:46.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:47.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:47.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:47.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:47.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:48.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:48.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:48.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:48.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:49.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:49.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:49.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:49.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:50.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:50.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:50.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:50.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:51.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:51.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:51.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:51.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:52.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:52.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:52.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:52.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:53.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:53.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:53.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:53.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:54.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:54.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:54.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:54.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:55.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:55.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:55.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:55.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:56.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:56.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:56.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:56.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:57.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:57.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:57.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:57.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:58.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:58.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:58.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:58.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:59.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:57:59.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:57:59.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:57:59.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:00.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:00.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:00.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:00.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:01.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:01.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:01.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:01.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:02.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:02.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:02.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:02.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:03.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:03.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:03.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:03.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:04.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:04.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:04.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:04.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:05.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:05.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:05.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:05.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:06.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:06.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:06.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:06.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:07.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:07.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:07.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:07.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:08.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:08.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:08.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:08.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:09.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:09.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:09.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:09.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:10.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:10.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:10.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:10.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:11.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:11.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:11.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:11.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:12.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:12.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:12.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:12.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:13.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:13.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:13.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:13.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:14.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:14.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:14.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:14.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:15.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:15.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:15.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:15.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:16.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:16.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:16.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:16.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:17.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:17.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:17.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:17.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:18.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:18.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:18.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:18.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:19.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:19.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:19.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:19.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:20.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:20.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:20.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:20.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:21.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:21.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:21.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:21.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:22.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:22.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:22.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:22.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:23.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:23.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:23.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:23.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:24.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:24.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:24.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:24.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:25.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:25.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:25.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:25.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:26.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:26.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:26.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:26.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:27.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:27.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:27.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:27.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:28.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:28.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:28.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:28.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:29.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:29.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:29.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:29.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:30.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:30.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:30.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:30.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:31.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:31.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:31.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:31.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:32.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:32.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:32.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:32.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:33.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:33.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:33.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:33.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:34.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:34.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:34.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:34.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:35.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:35.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:35.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:35.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:36.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:36.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:36.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:36.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:37.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:37.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:37.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:37.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:38.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:38.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:38.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:38.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:39.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:39.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:39.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:39.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:40.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:40.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:40.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:40.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:41.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:41.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:41.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:41.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:42.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:42.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:42.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:42.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:43.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:43.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:43.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:43.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:44.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:44.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:44.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:44.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:45.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:45.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:45.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:45.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:46.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:46.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:46.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:46.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:47.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:47.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:47.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:47.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:48.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:48.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:48.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:48.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:49.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:49.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:49.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:49.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:50.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:50.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:50.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:50.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:51.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:51.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:51.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:51.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:52.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:52.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:52.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:52.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:53.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:53.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:53.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:53.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:54.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:54.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:54.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:54.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:55.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:55.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:55.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:55.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:56.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:56.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:56.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:56.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:57.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:57.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:57.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:57.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:58.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:58.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:58.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:58.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:59.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:58:59.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:58:59.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:58:59.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:00.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:00.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:00.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:00.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:01.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:01.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:01.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:01.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:02.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:02.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:02.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:02.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:03.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:03.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:03.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:03.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:04.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:04.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:04.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:04.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:05.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:05.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:05.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:05.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:06.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:06.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:06.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:06.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:07.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:07.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:07.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:07.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:08.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:08.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:08.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:08.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:09.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:09.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:09.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:09.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:09.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:09.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:10.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:10.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:10.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:10.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:11.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:11.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:12.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:11.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:12.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:12.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:13.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:13.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:13.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:13.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:14.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:14.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:14.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:14.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:15.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:15.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:15.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:15.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:16.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:16.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:16.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:16.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:17.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:17.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:17.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:17.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:18.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:18.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:18.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:18.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:18.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:18.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:19.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:19.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:20.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:20.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:20.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:20.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:21.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:21.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:21.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:21.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:22.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:22.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:22.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:22.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:23.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:22.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:23.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:23.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:24.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:24.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:24.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:24.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:24.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:24.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:25.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:25.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:25.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:25.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:26.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:26.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:26.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:26.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:27.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:27.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:27.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:27.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:28.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:28.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:28.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:28.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:29.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:29.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:29.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:29.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:30.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:30.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:30.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:30.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:31.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:31.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:31.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:31.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:32.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:32.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:32.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:32.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:33.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:33.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:33.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:33.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:34.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:34.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:34.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:34.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:35.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:35.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:35.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:35.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:36.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:36.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:36.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:36.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:37.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:37.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:37.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:37.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:38.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:38.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:38.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:38.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:39.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:39.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:39.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:39.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:40.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:40.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:40.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:40.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:41.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:41.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:41.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:41.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:42.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:42.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:42.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:42.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:43.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:43.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:43.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:43.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:44.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:44.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:44.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:44.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:45.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:45.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:45.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:45.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:46.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:46.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:46.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:46.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:47.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:47.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:47.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:47.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:48.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:48.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:48.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:48.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:49.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:49.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:49.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:49.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:50.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:50.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:50.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:50.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:51.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:51.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:52.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:52.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:52.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:52.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:53.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:53.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:53.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:53.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:54.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:54.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:54.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:54.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:55.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:55.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:55.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:55.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:56.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:56.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:56.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:56.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:57.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:57.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:57.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:57.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:57.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:57.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:58.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:58.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:59.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T22:59:59.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T22:59:59.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T22:59:59.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:00.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:00.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:00.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:00.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:01.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:01.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:01.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:01.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:01.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:01.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:02.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:02.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:03.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:03.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:03.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:03.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:04.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:04.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:04.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:04.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:05.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:05.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:05.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:05.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:06.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:06.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:06.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:06.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:07.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:07.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:07.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:07.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:08.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:08.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:08.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:08.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:09.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:09.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:09.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:09.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:10.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:10.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:10.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:10.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:11.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:11.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:11.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:11.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:12.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:12.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:12.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:12.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:13.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:13.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:13.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:13.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:14.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:14.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:14.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:14.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:15.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:15.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:15.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:15.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:16.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:16.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:16.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:16.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:17.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:17.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:17.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:17.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:18.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:18.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:18.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:18.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:19.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:19.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:19.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:19.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:20.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:20.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:20.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:20.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:21.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:21.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:21.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:21.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:22.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:22.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:22.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:22.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:23.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:23.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:23.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:23.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:24.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:24.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:24.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:24.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:25.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:25.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:25.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:25.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:25.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:25.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:26.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:26.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:26.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:26.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:27.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:27.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:27.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:27.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:28.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:28.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:28.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:28.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:29.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:29.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:29.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:29.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:30.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:30.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:31.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:31.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:31.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:31.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:32.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:32.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:32.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:32.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:32.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:32.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:33.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:33.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:33.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:33.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:34.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:34.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:34.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:34.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:35.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:35.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:35.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:35.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:36.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:36.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:36.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:36.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:37.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:37.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:37.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:37.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:38.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:38.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:38.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:38.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:39.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:39.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:40.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:39.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:40.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:40.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:41.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:41.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:41.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:41.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:42.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:42.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:43.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:43.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:43.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:43.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:44.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:44.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:44.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:44.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:45.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:45.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:45.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:45.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:45.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:45.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:46.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:46.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:46.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:46.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:47.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:47.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:47.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:47.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:48.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:48.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:48.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:48.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:49.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:49.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:49.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:49.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:50.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:50.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:50.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:50.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:51.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:51.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:51.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:51.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:52.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:52.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:52.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:52.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:53.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:53.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:53.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:53.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:54.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:54.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:54.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:54.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:55.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:55.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:55.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:55.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:56.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:56.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:56.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:56.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:57.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:57.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:57.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:57.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:58.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:58.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:58.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:58.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:59.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:00:59.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:00:59.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:00:59.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:00.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:00.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:00.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:00.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:01.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:01.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:01.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:01.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:02.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:02.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:02.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:02.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:03.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:03.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:03.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:03.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:04.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:04.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:04.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:04.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:05.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:05.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:05.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:05.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:06.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:06.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:06.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:06.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:07.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:07.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:07.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:07.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:08.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:08.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:08.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:08.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:09.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:09.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:09.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:09.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:10.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:10.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:10.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:10.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:11.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:11.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:11.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:11.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:12.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:12.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:12.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:12.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:13.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:13.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:13.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:13.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:14.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:14.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:14.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:14.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:15.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:15.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:15.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:15.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:16.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:16.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:16.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:16.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:17.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:17.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:17.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:17.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:18.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:18.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:18.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:18.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:19.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:19.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:19.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:19.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:20.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:20.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:20.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:20.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:21.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:21.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:21.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:21.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:22.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:22.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:22.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:22.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:23.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:23.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:23.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:23.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:24.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:24.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:24.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:24.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:25.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:25.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:25.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:25.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:26.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:26.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:26.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:26.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:27.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:27.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:27.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:27.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:28.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:28.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:28.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:28.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:29.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:29.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:29.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:29.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:30.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:30.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:30.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:30.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:31.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:31.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:31.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:31.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:32.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:32.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:32.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:32.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:33.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:33.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:33.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:33.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:34.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:34.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:34.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:34.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:35.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:35.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:35.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:35.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:36.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:36.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:36.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:36.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:37.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:37.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:37.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:37.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:38.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:38.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:38.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:38.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:39.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:39.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:39.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:39.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:40.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:40.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:40.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:40.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:41.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:41.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:41.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:41.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:42.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:42.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:42.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:42.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:43.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:43.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:43.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:43.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:44.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:44.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:44.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:44.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:45.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:45.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:45.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:45.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:46.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:46.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:46.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:46.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:47.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:47.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:47.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:47.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:48.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:48.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:48.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:48.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:49.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:49.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:49.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:49.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:50.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:50.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:50.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:50.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:51.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:51.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:51.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:51.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:52.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:52.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:52.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:52.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:53.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:53.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:53.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:53.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:54.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:54.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:54.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:54.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:55.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:55.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:55.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:55.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:56.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:56.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:56.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:56.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:57.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:57.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:57.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:57.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:58.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:58.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:58.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:58.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:59.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:01:59.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:01:59.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:01:59.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:00.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:00.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:00.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:00.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:01.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:01.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:01.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:01.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:02.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:02.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:02.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:02.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:03.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:03.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:03.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:03.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:04.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:04.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:04.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:04.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:05.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:05.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:05.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:05.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:06.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:06.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:06.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:06.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:07.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:07.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:07.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:07.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:08.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:08.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:08.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:08.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:09.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:09.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:09.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:09.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:10.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:10.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:10.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:10.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:11.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:11.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:11.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:11.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:12.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:12.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:12.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:12.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:13.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:13.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:13.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:13.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:14.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:14.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:14.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:14.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:15.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:15.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:15.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:15.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:16.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:16.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:16.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:16.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:17.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:17.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:17.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:17.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:18.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:18.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:18.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:18.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:19.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:19.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:19.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:19.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:20.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:20.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:20.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:20.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:21.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:21.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:21.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:21.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:22.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:22.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:22.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:22.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:23.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:23.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:23.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:23.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:24.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:24.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:24.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:24.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:25.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:25.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:25.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:25.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:26.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:26.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:26.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:26.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:27.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:27.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:27.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:27.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:28.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:28.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:28.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:28.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:29.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:29.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:29.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:29.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:30.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:30.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:30.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:30.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:31.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:31.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:31.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:31.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:32.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:32.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:32.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:32.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:33.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:33.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:33.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:33.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:34.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:34.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:34.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:34.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:35.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:35.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:35.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:35.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:36.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:36.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:36.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:36.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:37.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:37.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:37.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:37.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:38.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:38.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:38.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:38.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:39.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:39.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:39.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:39.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:40.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:40.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:40.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:40.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:41.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:41.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:41.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:41.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:42.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:42.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:42.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:42.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:43.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:43.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:43.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:43.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:44.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:44.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:44.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:44.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:45.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:45.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:45.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:45.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:46.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:46.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:46.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:46.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:47.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:47.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:47.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:47.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:48.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:48.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:48.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:48.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:49.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:49.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:49.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:49.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:50.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:50.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:50.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:50.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:51.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:51.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:51.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:51.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:52.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:52.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:52.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:52.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:53.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:53.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:53.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:53.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:54.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:54.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:54.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:54.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:55.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:55.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:55.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:55.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:56.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:56.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:56.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:56.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:57.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:57.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:57.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:57.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:58.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:58.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:58.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:58.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:59.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:02:59.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:02:59.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:02:59.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:00.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:00.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:00.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:00.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:01.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:01.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:01.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:01.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:02.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:02.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:02.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:02.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:03.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:03.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:03.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:03.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:04.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:04.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:04.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:04.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:05.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:05.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:05.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:05.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:06.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:06.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:06.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:06.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:07.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:07.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:07.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:07.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:08.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:08.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:08.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:08.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:09.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:09.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:09.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:09.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:10.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:10.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:10.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:10.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:11.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:11.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:11.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:11.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:12.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:12.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:12.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:12.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:13.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:13.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:13.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:13.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:14.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:14.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:14.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:14.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:15.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:15.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:15.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:15.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:16.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:16.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:16.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:16.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:17.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:17.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:17.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:17.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:18.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:18.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:18.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:18.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:19.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:19.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:19.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:19.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:20.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:20.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:20.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:20.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:21.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:21.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:21.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:21.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:22.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:22.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:22.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:22.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:23.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:23.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:23.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:23.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:24.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:24.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:24.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:24.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:25.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:25.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:25.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:25.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:26.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:26.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:26.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:26.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:27.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:27.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:27.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:27.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:28.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:28.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:28.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:28.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:29.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:29.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:29.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:29.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:30.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:30.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:30.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:30.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:31.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:31.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:31.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:31.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:32.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:32.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:32.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:32.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:33.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:33.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:33.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:33.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:34.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:34.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:34.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:34.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:35.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:35.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:35.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:35.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:36.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:36.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:36.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:36.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:37.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:37.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:37.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:37.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:38.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:38.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:38.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:38.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:39.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:39.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:39.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:39.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:40.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:40.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:40.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:40.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:41.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:41.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:41.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:41.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:42.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:42.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:42.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:42.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:43.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:43.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:43.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:43.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:44.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:44.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:44.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:44.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:45.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:45.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:45.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:45.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:46.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:46.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:46.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:46.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:47.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:47.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:47.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:47.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:48.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:48.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:48.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:48.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:49.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:49.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:49.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:49.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:50.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:50.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:50.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:50.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:51.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:51.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:51.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:51.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:52.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:52.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:52.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:52.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:53.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:53.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:53.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:53.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:54.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:54.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:54.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:54.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:55.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:55.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:55.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:55.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:56.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:56.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:56.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:56.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:57.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:57.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:57.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:57.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:58.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:58.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:58.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:58.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:59.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:03:59.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:03:59.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:03:59.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:00.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:00.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:00.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:00.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:01.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:01.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:01.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:01.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:02.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:02.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:02.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:02.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:03.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:03.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:03.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:03.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:04.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:04.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:04.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:04.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:05.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:05.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:05.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:05.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:06.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:06.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:06.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:06.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:07.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:07.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:07.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:07.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:08.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:08.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:08.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:08.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:09.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:09.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:09.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:09.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:10.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:10.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:10.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:10.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:11.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:11.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:11.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:11.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:12.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:12.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:12.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:12.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:13.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:13.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:13.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:13.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:14.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:14.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:14.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:14.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:15.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:15.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:15.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:15.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:16.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:16.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:16.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:16.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:17.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:17.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:17.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:17.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:18.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:18.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:18.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:18.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:19.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:19.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:19.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:19.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:20.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:20.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:20.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:20.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:21.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:21.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:21.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:21.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:22.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:22.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:22.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:22.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:23.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:23.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:23.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:23.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:24.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:24.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:24.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:24.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:25.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:25.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:25.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:25.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:26.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:26.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:26.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:26.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:27.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:27.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:27.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:27.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:28.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:28.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:28.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:28.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:29.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:29.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:29.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:29.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:30.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:30.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:30.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:30.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:31.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:31.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:31.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:31.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:32.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:32.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:32.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:32.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:33.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:33.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:33.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:33.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:34.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:34.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:34.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:34.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:35.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:35.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:35.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:35.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:36.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:36.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:36.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:36.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:37.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:37.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:37.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:37.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:38.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:38.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:38.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:38.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:39.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:39.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:39.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:39.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:40.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:40.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:40.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:40.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:41.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:41.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:41.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:41.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:42.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:42.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:42.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:42.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:43.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:43.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:43.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:43.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:44.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:44.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:44.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:44.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:45.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:45.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:45.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:45.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:46.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:46.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:46.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:46.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:47.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:47.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:47.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:47.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:48.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:48.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:48.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:48.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:49.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:49.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:49.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:49.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:50.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:50.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:50.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:50.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:51.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:51.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:51.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:51.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:52.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:52.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:52.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:52.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:53.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:53.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:53.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:53.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:54.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:54.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:54.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:54.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:55.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:55.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:55.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:55.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:56.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:56.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:56.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:56.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:57.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:57.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:57.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:57.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:58.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:58.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:58.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:58.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:59.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:04:59.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:04:59.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:04:59.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:00.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:00.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:00.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:00.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:01.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:01.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:01.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:01.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:02.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:02.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:02.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:02.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:03.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:03.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:03.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:03.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:04.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:04.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:04.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:04.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:05.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:05.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:05.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:05.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:06.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:06.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:06.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:06.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:07.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:07.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:07.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:07.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:08.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:08.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:08.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:08.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:09.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:09.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:09.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:09.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:10.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:10.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:10.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:10.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:11.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:11.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:11.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:11.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:12.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:12.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:12.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:12.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:13.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:13.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:13.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:13.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:14.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:14.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:14.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:14.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:15.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:15.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:15.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:15.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:16.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:16.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:16.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:16.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:17.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:17.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:17.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:17.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:18.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:18.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:18.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:18.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:19.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:19.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:19.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:19.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:20.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:20.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:20.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:20.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:21.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:21.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:22.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:21.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:22.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:22.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:23.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:23.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:23.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:23.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:24.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:24.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:24.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:24.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:25.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:25.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:25.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:25.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:25.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:25.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:26.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:26.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:27.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:27.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:27.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:27.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:28.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:28.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:28.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:28.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:29.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:29.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:29.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:29.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:29.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:29.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:30.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:30.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:31.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:31.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:31.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:31.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:32.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:32.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:32.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:32.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:32.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:33.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:33.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:34.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:34.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:34.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:34.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:35.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:35.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:35.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:35.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:36.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:36.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:36.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:36.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:37.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:37.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:37.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:37.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:38.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:38.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:38.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:38.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:39.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:39.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:39.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:39.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:40.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:40.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:40.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:40.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:41.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:41.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:41.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:41.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:42.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:42.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:42.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:42.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:43.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:43.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:43.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:43.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:44.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:44.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:44.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:44.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:45.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:45.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:45.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:45.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:46.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:46.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:46.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:46.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:47.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:47.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:47.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:47.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:48.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:48.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:48.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:48.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:49.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:49.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:49.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:49.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:50.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:50.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:50.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:50.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:51.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:51.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:51.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:51.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:52.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:52.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:52.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:52.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:53.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:53.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:53.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:53.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:54.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:54.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:54.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:54.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:55.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:55.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:55.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:55.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:56.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:56.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:56.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:56.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:57.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:57.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:57.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:57.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:58.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:58.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:58.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:58.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:59.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:05:59.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:05:59.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:05:59.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:00.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:00.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:00.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:00.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:01.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:01.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:01.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:01.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:02.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:02.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:02.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:02.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:03.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:03.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:03.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:03.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:04.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:04.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:04.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:04.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:05.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:05.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:05.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:05.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:06.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:06.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:06.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:06.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:07.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:07.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:07.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:07.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:08.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:08.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:08.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:08.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:09.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:09.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:09.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:09.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:10.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:10.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:10.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:10.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:11.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:11.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:11.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:11.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:12.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:12.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:12.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:12.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:13.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:13.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:13.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:13.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:14.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:14.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:14.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:14.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:15.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:15.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:15.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:15.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:16.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:16.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:16.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:16.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:17.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:17.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:17.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:17.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:18.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:18.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:18.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:18.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:19.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:19.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:19.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:19.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:20.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:20.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:20.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:20.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:21.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:21.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:21.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:21.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:22.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:22.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:22.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:22.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:23.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:23.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:23.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:23.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:24.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:24.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:24.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:24.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:25.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:25.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:25.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:25.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:26.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:26.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:26.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:26.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:27.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:27.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:27.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:27.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:28.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:28.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:28.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:28.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:29.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:29.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:29.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:29.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:30.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:30.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:30.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:30.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:31.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:31.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:31.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:31.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:32.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:32.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:32.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:32.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:33.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:33.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:33.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:33.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:34.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:34.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:34.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:34.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:35.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:35.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:35.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:35.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:36.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:36.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:36.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:36.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:37.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:37.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:37.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:37.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:38.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:38.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:38.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:38.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:39.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:39.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:39.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:39.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:40.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:40.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:40.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:40.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:41.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:41.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:41.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:41.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:42.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:42.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:42.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:42.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:43.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:43.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:43.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:43.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:44.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:44.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:44.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:44.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:45.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:45.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:45.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:45.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:46.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:46.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:46.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:46.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:47.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:47.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:47.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:47.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:48.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:48.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:48.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:48.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:49.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:49.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:49.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:49.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:50.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:50.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:50.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:50.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:51.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:51.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:51.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:51.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:52.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:52.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:52.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:52.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:53.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:53.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:53.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:53.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:54.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:54.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:54.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:54.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:55.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:55.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:55.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:55.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:56.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:56.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:56.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:56.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:57.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:57.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:57.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:57.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:58.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:58.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:58.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:58.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:59.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:06:59.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:06:59.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:06:59.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:00.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:00.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:00.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:00.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:01.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:01.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:01.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:01.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:02.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:02.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:02.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:02.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:03.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:03.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:03.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:03.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:04.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:04.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:04.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:04.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:05.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:05.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:05.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:05.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:06.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:06.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:06.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:06.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:07.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:07.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:07.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:07.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:08.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:08.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:08.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:08.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:09.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:09.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:09.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:09.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:10.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:10.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:10.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:10.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:11.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:11.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:11.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:11.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:12.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:12.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:12.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:12.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:13.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:13.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:13.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:13.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:14.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:14.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:14.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:14.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:15.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:15.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:15.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:15.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:16.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:16.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:16.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:16.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:17.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:17.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:17.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:17.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:18.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:18.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:18.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:18.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:19.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:19.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:19.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:19.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:20.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:20.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:20.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:20.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:21.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:21.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:21.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:21.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:22.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:22.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:22.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:22.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:23.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:23.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:23.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:23.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:24.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:24.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:24.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:24.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:25.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:25.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:25.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:25.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:26.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:26.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:26.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:26.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:27.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:27.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:27.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:27.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:28.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:28.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:28.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:28.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:29.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:29.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:29.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:29.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:30.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:30.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:30.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:30.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:31.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:31.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:31.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:31.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:32.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:32.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:32.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:32.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:33.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:33.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:33.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:33.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:34.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:34.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:34.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:34.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:35.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:35.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:35.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:35.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:36.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:36.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:37.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:36.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:37.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:37.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:38.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:38.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:38.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:38.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:39.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:38.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:39.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:39.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:39.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:39.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:40.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:40.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:41.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:41.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:41.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:41.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:42.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:42.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:42.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:42.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:43.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:43.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:43.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:43.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:44.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:44.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:44.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:44.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:45.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:45.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:45.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:45.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:46.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:46.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:46.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:46.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:47.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:47.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:47.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:47.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:48.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:48.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:48.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:48.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:49.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:49.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:49.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:49.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:50.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:50.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:50.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:50.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:51.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:51.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:51.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:51.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:52.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:52.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:52.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:52.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:53.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:53.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:53.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:53.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:54.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:54.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:54.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:54.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:55.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:55.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:55.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:55.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:56.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:56.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:56.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:56.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:57.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:57.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:57.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:57.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:58.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:58.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:58.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:58.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:59.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:07:59.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:07:59.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:07:59.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:00.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:00.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:00.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:00.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:01.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:01.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:01.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:01.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:02.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:02.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:02.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:02.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:03.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:03.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:03.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:03.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:04.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:04.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:04.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:04.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:05.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:05.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:05.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:05.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:06.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:05.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:06.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:06.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:07.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:07.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:07.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:07.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:08.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:08.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:08.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:08.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:09.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:08.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:09.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:09.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:10.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:10.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:10.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:10.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:11.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:11.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:11.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:11.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:11.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:11.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:12.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:12.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:13.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:13.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:13.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:13.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:14.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:14.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:14.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:14.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:15.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:15.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:15.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:15.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:16.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:16.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:16.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:16.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:17.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:17.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:17.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:17.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:18.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:18.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:18.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:18.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:19.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:19.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:19.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:19.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:20.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:20.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:20.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:20.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:21.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:21.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:21.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:21.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:22.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:22.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:22.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:22.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:23.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:23.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:23.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:23.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:24.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:24.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:24.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:24.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:25.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:25.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:25.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:25.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:26.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:26.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:26.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:26.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:27.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:27.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:27.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:27.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:28.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:28.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:28.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:28.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:29.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:29.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:29.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:29.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:30.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:30.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:30.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:30.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:31.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:31.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:31.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:31.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:32.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:32.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:32.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:32.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:33.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:33.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:33.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:33.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:34.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:34.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:34.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:34.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:35.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:35.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:35.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:35.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:36.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:36.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:36.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:36.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:37.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:37.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:37.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:37.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:38.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:38.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:38.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:38.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:39.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:39.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:39.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:39.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:40.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:40.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:40.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:40.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:41.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:41.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:41.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:41.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:42.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:42.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:42.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:42.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:43.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:43.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:43.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:43.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:44.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:44.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:44.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:44.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:45.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:45.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:45.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:45.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:46.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:46.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:46.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:46.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:47.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:47.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:47.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:47.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:48.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:48.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:48.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:48.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:49.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:49.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:49.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:49.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:50.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:50.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:50.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:50.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:51.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:51.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:51.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:51.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:52.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:52.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:52.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:52.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:53.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:53.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:53.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:53.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:54.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:54.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:54.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:54.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:55.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:55.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:55.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:55.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:56.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:56.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:56.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:56.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:57.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:57.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:57.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:57.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:58.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:58.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:58.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:58.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:59.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:08:59.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:08:59.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:08:59.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:00.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:00.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:00.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:00.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:01.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:01.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:01.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:01.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:02.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:02.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:02.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:02.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:03.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:03.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:03.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:03.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:04.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:04.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:04.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:04.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:05.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:05.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:05.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:05.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:06.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:06.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:06.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:06.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:07.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:07.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:07.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:07.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:08.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:08.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:08.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:08.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:09.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:09.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:09.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:09.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:10.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:10.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:10.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:10.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:11.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:11.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:11.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:11.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:12.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:12.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:12.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:12.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:13.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:13.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:13.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:13.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:14.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:14.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:14.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:14.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:15.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:15.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:15.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:15.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:16.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:16.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:16.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:16.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:17.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:17.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:17.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:17.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:18.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:18.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:18.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:18.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:19.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:19.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:19.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:19.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:20.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:20.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:20.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:20.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:21.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:21.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:21.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:21.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:22.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:22.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:22.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:22.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:23.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:23.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:23.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:23.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:24.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:24.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:24.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:24.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:25.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:25.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:25.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:25.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:26.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:26.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:26.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:26.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:27.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:27.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:27.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:27.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:28.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:28.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:28.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:28.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:29.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:29.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:29.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:29.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:30.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:30.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:30.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:30.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:31.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:31.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:31.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:31.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:32.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:32.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:32.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:32.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:33.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:33.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:33.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:33.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:34.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:34.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:34.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:34.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:35.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:35.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:35.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:35.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:36.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:36.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:36.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:36.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:37.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:37.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:37.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:37.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:38.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:38.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:38.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:38.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:39.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:39.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:39.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:39.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:40.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:40.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:40.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:40.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:41.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:41.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:41.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:41.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:42.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:42.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:42.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:42.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:43.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:43.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:43.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:43.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:44.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:44.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:44.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:44.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:45.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:45.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:45.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:45.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:46.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:46.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:46.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:46.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:47.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:47.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:47.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:47.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:48.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:48.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:48.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:48.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:49.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:49.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:49.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:49.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:50.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:50.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:50.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:50.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:51.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:51.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:51.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:51.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:52.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:52.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:52.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:52.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:53.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:53.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:53.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:53.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:54.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:54.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:54.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:54.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:55.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:55.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:55.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:55.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:56.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:56.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:56.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:56.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:57.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:57.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:57.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:57.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:58.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:58.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:58.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:58.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:59.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:09:59.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:09:59.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:09:59.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:00.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:00.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:00.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:00.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:01.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:01.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:01.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:01.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:02.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:02.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:02.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:02.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:03.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:03.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:03.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:03.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:04.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:04.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:04.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:04.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:05.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:05.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:05.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:05.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:06.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:06.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:06.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:06.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:07.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:07.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:07.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:07.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:08.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:08.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:08.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:08.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:09.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:09.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:09.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:09.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:10.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:10.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:10.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:10.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:11.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:11.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:11.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:11.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:12.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:12.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:12.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:12.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:13.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:13.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:13.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:13.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:14.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:14.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:14.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:14.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:15.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:15.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:15.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:15.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:16.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:16.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:16.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:16.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:17.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:17.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:17.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:17.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:18.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:18.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:18.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:18.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:19.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:19.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:19.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:19.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:20.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:20.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:20.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:20.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:21.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:21.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:21.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:21.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:22.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:22.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:22.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:22.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:23.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:23.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:23.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:23.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:24.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:24.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:24.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:24.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:25.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:25.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:25.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:25.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:26.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:26.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:26.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:26.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:27.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:27.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:27.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:27.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:28.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:28.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:28.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:28.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:29.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:29.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:29.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:29.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:30.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:30.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:30.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:30.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:31.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:31.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:31.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:31.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:32.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:32.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:32.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:32.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:33.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:33.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:33.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:33.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:34.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:34.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:34.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:34.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:35.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:35.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:35.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:35.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:36.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:36.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:36.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:36.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:37.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:37.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:37.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:37.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:38.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:38.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:38.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:38.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:39.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:39.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:39.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:39.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:40.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:40.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:40.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:40.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:41.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:41.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:41.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:41.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:42.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:42.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:42.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:42.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:43.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:43.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:43.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:43.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:44.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:44.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:44.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:44.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:45.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:45.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:45.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:45.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:46.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:46.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:46.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:46.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:47.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:47.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:47.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:47.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:48.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:48.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:48.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:48.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:49.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:49.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:49.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:49.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:50.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:50.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:50.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:50.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:51.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:51.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:51.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:51.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:52.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:52.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:52.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:52.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:53.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:53.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:53.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:53.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:54.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:54.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:54.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:54.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:55.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:55.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:55.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:55.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:56.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:56.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:56.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:56.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:57.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:57.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:57.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:57.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:58.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:58.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:58.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:58.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:59.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:10:59.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:10:59.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:10:59.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:00.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:00.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:00.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:00.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:01.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:01.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:01.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:01.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:02.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:02.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:02.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:02.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:03.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:03.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:03.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:03.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:04.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:04.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:04.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:04.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:05.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:05.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:05.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:05.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:06.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:06.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:06.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:06.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:07.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:07.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:07.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:07.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:08.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:08.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:08.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:08.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:09.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:09.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:09.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:09.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:10.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:10.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:10.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:10.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:11.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:11.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:11.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:11.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:12.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:12.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:12.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:12.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:13.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:13.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:13.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:13.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:14.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:14.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:14.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:14.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:15.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:15.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:15.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:15.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:16.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:16.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:16.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:16.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:17.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:17.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:17.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:17.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:18.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:18.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:18.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:18.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:19.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:19.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:19.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:19.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:20.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:20.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:20.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:20.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:21.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:21.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:21.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:21.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:22.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:22.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:22.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:22.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:23.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:23.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:23.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:23.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:24.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:24.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:24.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:24.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:25.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:25.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:25.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:25.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:26.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:26.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:26.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:26.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:27.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:27.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:27.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:27.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:28.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:28.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:28.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:28.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:29.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:29.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:29.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:29.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:30.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:30.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:30.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:30.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:31.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:31.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:31.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:31.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:32.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:32.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:32.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:32.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:33.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:33.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:33.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:33.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:34.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:34.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:34.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:34.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:35.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:35.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:35.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:35.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:36.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:36.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:36.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:36.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:37.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:37.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:37.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:37.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:38.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:38.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:38.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:38.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:39.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:39.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:39.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:39.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:40.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:40.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:40.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:40.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:41.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:41.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:41.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:41.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:42.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:42.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:42.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:42.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:43.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:43.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:43.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:43.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:44.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:44.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:44.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:44.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:45.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:45.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:45.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:45.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:46.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:46.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:46.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:46.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:47.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:47.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:47.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:47.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:48.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:48.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:48.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:48.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:49.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:49.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:49.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:49.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:50.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:50.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:50.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:50.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:51.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:51.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:51.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:51.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:52.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:52.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:52.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:52.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:53.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:53.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:53.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:53.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:54.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:54.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:54.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:54.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:55.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:55.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:55.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:55.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:56.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:56.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:56.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:56.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:57.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:57.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:57.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:57.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:58.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:58.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:58.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:58.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:59.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:11:59.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:11:59.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:11:59.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:00.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:00.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:00.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:00.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:01.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:01.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:01.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:01.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:02.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:02.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:02.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:02.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:03.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:03.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:03.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:03.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:04.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:04.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:04.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:04.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:05.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:05.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:05.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:05.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:06.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:06.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:06.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:06.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:07.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:07.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:07.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:07.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:08.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:08.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:08.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:08.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:09.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:09.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:09.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:09.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:10.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:10.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:10.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:10.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:11.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:11.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:11.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:11.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:12.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:12.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:12.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:12.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:13.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:13.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:13.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:13.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:14.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:14.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:14.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:14.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:15.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:15.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:15.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:15.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:16.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:16.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:16.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:16.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:17.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:17.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:17.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:17.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:18.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:18.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:18.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:18.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:19.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:19.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:19.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:19.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:20.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:20.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:20.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:20.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:21.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:21.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:21.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:21.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:22.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:22.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:22.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:22.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:23.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:23.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:23.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:23.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:24.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:24.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:24.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:24.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:25.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:25.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:25.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:25.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:26.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:26.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:26.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:26.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:27.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:27.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:27.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:27.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:28.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:28.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:28.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:28.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:29.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:29.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:29.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:29.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:30.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:30.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:30.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:30.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:31.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:31.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:31.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:31.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:32.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:32.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:32.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:32.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:33.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:33.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:33.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:33.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:34.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:34.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:34.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:34.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:35.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:35.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:35.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:35.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:36.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:36.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:36.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:36.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:37.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:37.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:37.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:37.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:38.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:38.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:38.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:38.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:39.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:39.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:39.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:39.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:40.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:40.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:40.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:40.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:41.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:41.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:41.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:41.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:42.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:42.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:42.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:42.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:43.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:43.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:43.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:43.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:44.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:44.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:44.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:44.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:45.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:45.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:45.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:45.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:46.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:46.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:46.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:46.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:47.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:47.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:47.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:47.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:48.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:48.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:49.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:49.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:49.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:49.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:50.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:50.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:50.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:50.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:51.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:51.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:51.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:51.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:52.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:52.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:52.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:52.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:53.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:53.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:53.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:53.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:54.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:54.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:54.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:54.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:55.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:55.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:55.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:55.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:55.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:55.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:56.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:56.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:56.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:56.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:57.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:57.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:58.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:58.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:58.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:58.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:59.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:12:59.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:12:59.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:12:59.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:00.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:00.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:00.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:00.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:01.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:01.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:01.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:01.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:02.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:02.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:02.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:02.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:03.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:03.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:03.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:03.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:04.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:04.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:04.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:04.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:05.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:05.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:05.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:05.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:06.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:06.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:06.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:06.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:07.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:07.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:07.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:07.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:08.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:08.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:08.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:08.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:09.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:09.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:09.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:09.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:10.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:10.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:10.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:10.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:11.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:11.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:11.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:11.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:12.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:12.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:12.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:12.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:13.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:13.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:13.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:13.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:14.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:14.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:14.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:14.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:15.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:15.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:15.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:15.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:16.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:16.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:16.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:16.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:17.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:17.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:17.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:17.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:18.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:18.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:18.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:18.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:19.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:19.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:19.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:19.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:20.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:20.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:20.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:20.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:21.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:21.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:21.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:21.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:22.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:22.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:22.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:22.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:23.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:23.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:23.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:23.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:24.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:24.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:24.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:24.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:25.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:25.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:25.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:25.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:26.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:26.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:26.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:26.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:27.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:27.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:27.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:27.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:28.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:28.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:28.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:28.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:29.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:29.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:29.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:29.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:30.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:30.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:30.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:30.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:31.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:31.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:31.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:31.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:32.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:32.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:32.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:32.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:33.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:33.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:33.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:33.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:34.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:34.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:34.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:34.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:35.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:35.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:35.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:35.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:36.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:36.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:36.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:36.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:37.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:37.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:37.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:37.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:38.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:38.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:38.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:38.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:39.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:39.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:39.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:39.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:40.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:40.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:40.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:40.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:41.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:41.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:41.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:41.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:42.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:42.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:42.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:42.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:43.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:43.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:43.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:43.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:44.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:44.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:44.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:44.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:45.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:45.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:45.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:45.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:45.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:45.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:46.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:46.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:46.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:46.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:47.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:47.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:47.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:47.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:48.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:48.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:48.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:48.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:49.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:49.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:49.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:49.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:50.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:50.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:50.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:50.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:51.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:51.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:51.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:51.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:52.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:52.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:53.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:52.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:53.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:53.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:54.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:54.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:54.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:54.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:55.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:55.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:55.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:55.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:55.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:55.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:56.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:56.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:57.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:57.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:57.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:57.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:58.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:58.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:58.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:58.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:58.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:13:58.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:13:59.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:13:59.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:00.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:00.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:00.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:00.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:01.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:01.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:01.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:01.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:02.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:02.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:02.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:02.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:03.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:03.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:03.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:03.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:04.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:04.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:04.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:04.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:05.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:05.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:05.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:05.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:06.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:06.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:06.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:06.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:07.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:07.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:07.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:07.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:08.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:08.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:08.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:08.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:09.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:09.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:09.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:09.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:10.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:10.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:10.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:10.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:11.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:11.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:11.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:11.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:12.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:12.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:12.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:12.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:13.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:13.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:13.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:13.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:14.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:14.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:14.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:14.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:15.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:15.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:15.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:15.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:16.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:16.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:16.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:16.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:17.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:17.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:17.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:17.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:18.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:18.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:18.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:18.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:19.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:19.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:19.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:19.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:20.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:20.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:20.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:20.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:21.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:21.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:21.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:21.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:22.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:22.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:22.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:22.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:23.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:23.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:23.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:23.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:24.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:24.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:24.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:24.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:25.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:25.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:25.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:25.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:26.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:26.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:26.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:26.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:27.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:27.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:27.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:27.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:28.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:28.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:28.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:28.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:29.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:29.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:29.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:29.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:30.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:30.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:30.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:30.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:31.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:31.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:31.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:31.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:32.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:32.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:32.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:32.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:33.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:33.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:33.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:33.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:34.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:34.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:34.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:34.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:35.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:35.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:35.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:35.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:36.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:36.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:36.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:36.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:37.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:37.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:37.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:37.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:38.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:38.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:38.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:38.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:39.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:39.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:39.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:39.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:40.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:40.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:40.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:40.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:41.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:41.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:41.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:41.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:42.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:42.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:42.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:42.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:43.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:43.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:43.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:43.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:44.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:44.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:44.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:44.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:45.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:45.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:45.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:45.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:46.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:46.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:46.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:46.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:47.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:47.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:47.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:47.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:48.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:48.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:48.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:48.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:49.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:49.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:49.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:49.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:50.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:50.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:50.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:50.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:51.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:51.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:51.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:51.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:52.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:52.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:52.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:52.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:53.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:53.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:53.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:53.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:54.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:54.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:54.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:54.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:55.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:55.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:55.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:55.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:56.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:56.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:56.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:56.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:57.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:57.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:57.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:57.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:58.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:58.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:58.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:58.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:59.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:14:59.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:14:59.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:14:59.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:00.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:00.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:00.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:00.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:01.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:01.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:01.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:01.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:02.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:02.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:02.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:02.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:03.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:03.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:03.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:03.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:04.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:04.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:04.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:04.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:05.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:05.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:05.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:05.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:06.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:06.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:06.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:06.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:07.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:07.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:07.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:07.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:08.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:08.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:08.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:08.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:08.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:08.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:09.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:09.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:10.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:10.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:10.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:10.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:11.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:11.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:11.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:11.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:12.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:12.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:12.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:12.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:13.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:13.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:13.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:13.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:13.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:13.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:14.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:14.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:14.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:14.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:15.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:15.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:16.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:15.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:16.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:16.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:17.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:17.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:17.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:17.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:18.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:18.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:18.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:18.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:19.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:19.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:19.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:19.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:20.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:20.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:20.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:20.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:21.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:21.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:21.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:21.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:21.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:21.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:22.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:22.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:23.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:23.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:23.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:23.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:24.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:24.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:24.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:24.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:25.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:25.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:25.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:25.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:26.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:26.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:26.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:26.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:27.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:27.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:27.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:27.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:28.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:28.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:28.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:28.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:29.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:29.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:29.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:29.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:30.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:30.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:30.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:30.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:31.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:31.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:31.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:31.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:32.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:32.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:32.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:32.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:33.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:33.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:33.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:33.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:33.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:33.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:34.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:34.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:35.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:34.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:35.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:35.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:36.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:36.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:36.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:36.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:37.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:37.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:37.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:37.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:37.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:37.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:38.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:38.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:38.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:38.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:39.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:39.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:39.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:39.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:40.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:40.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:41.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:41.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:41.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:41.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:42.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:42.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:42.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:42.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:43.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:43.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:43.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:43.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:44.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:44.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:44.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:44.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:45.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:45.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:45.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:45.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:46.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:46.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:46.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:46.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:47.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:47.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:47.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:47.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:48.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:48.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:48.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:48.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:49.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:49.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:49.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:49.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:49.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:49.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:50.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:50.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:50.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:50.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:51.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:51.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:51.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:51.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:52.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:52.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:52.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:52.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:53.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:53.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:53.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:53.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:54.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:54.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:54.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:54.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:55.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:55.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:55.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:55.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:56.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:56.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:56.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:56.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:57.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:57.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:57.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:57.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:58.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:58.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:58.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:58.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:59.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:15:59.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:15:59.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:15:59.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:00.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:00.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:00.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:00.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:01.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:01.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:01.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:01.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:02.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:02.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:02.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:02.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:03.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:03.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:03.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:03.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:04.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:04.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:04.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:04.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:05.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:05.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:05.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:05.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:06.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:06.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:06.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:06.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:07.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:07.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:07.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:07.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:08.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:08.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:08.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:08.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:09.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:09.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:09.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:09.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:10.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:10.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:10.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:10.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:11.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:11.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:11.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:11.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:12.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:12.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:12.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:12.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:13.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:13.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:13.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:13.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:14.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:14.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:14.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:14.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:15.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:15.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:15.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:15.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:16.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:16.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:16.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:16.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:17.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:17.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:17.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:17.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:18.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:18.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:18.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:18.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:19.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:19.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:19.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:19.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:20.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:20.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:20.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:20.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:21.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:21.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:21.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:21.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:22.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:22.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:22.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:22.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:23.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:23.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:23.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:23.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:24.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:24.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:24.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:24.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:25.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:25.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:25.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:25.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:26.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:26.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:26.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:26.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:27.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:27.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:27.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:27.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:28.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:28.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:28.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:28.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:29.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:29.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:29.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:29.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:30.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:30.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:30.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:30.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:31.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:31.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:31.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:31.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:32.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:32.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:32.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:32.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:33.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:33.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:33.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:33.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:34.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:34.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:34.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:34.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:35.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:35.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:35.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:35.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:36.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:36.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:36.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:36.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:37.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:37.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:37.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:37.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:38.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:38.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:38.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:38.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:39.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:39.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:39.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:39.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:40.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:40.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:40.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:40.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:41.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:41.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:41.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:41.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:42.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:42.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:43.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:42.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:43.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:43.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:44.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:44.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:44.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:44.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:45.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:45.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:45.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:45.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:45.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:45.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:46.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:46.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:47.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:47.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:47.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:47.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:48.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:48.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:48.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:48.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:48.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:48.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:49.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:49.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:49.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:49.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:50.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:50.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:51.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:51.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:51.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:51.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:52.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:52.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:52.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:52.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:52.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:52.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:53.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:53.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:53.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:53.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:54.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:54.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:55.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:55.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:55.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:55.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:56.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:56.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:56.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:56.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:56.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:56.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:57.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:57.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:57.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:57.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:58.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:58.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:58.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:58.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:59.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:16:59.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:16:59.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:16:59.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:00.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:00.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:00.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:00.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:01.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:01.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:01.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:01.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:02.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:02.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:02.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:02.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:03.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:03.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:03.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:03.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:04.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:04.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:04.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:04.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:05.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:05.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:05.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:05.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:06.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:06.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:06.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:06.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:07.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:07.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:07.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:07.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:08.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:08.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:08.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:08.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:09.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:09.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:09.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:09.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:10.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:10.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:10.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:10.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:11.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:11.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:11.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:11.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:12.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:12.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:12.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:12.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:13.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:13.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:13.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:13.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:14.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:14.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:14.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:14.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:15.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:15.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:15.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:15.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:16.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:16.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:16.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:16.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:17.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:17.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:17.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:17.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:18.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:18.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:18.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:18.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:19.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:19.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:19.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:19.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:20.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:20.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:20.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:20.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:21.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:21.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:21.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:21.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:22.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:22.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:22.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:22.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:23.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:23.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:23.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:23.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:24.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:24.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:24.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:24.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:25.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:25.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:25.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:25.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:26.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:26.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:26.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:26.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:27.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:27.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:27.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:27.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:28.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:28.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:28.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:28.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:29.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:29.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:29.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:29.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:30.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:30.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:30.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:30.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:31.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:31.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:31.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:31.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:32.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:32.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:32.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:32.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:33.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:33.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:33.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:33.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:34.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:34.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:34.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:34.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:35.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:35.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:35.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:35.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:36.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:36.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:36.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:36.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:37.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:37.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:37.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:37.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:38.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:38.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:38.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:38.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:39.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:39.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:39.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:39.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:40.217 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T23:17:40.213+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5561d63e73c0 msgr2=0x5561d6487f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-19T23:17:40.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:40.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:40.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:40.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:41.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:41.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:41.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:41.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:42.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:42.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:42.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:42.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:43.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:43.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:43.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:43.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:44.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:44.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:44.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:44.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:45.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:45.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:45.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:45.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:46.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:46.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:46.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:46.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:47.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:47.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:47.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:47.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:48.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:48.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:48.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:48.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:49.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:49.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:50.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:50.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:50.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:50.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:51.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:51.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:51.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:51.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:52.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:52.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:52.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:52.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:53.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:53.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:53.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:53.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:54.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:54.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:54.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:54.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:55.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:55.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:55.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:55.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:56.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:56.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:56.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:56.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:57.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:57.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:57.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:57.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:58.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:58.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:58.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:58.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:59.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:17:59.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:17:59.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:17:59.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:00.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:00.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:00.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:00.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:01.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:01.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:01.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:01.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:02.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:02.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:02.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:02.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:03.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:03.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:03.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:03.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:04.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:04.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:04.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:04.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:05.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:05.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:05.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:05.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:06.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:06.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:06.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:06.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:07.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:07.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:07.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:07.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:08.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:08.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:08.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:08.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:09.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:09.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:09.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:09.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:10.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:10.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:10.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:10.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:11.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:11.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:11.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:11.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:12.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:12.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:12.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:12.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:13.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:13.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:13.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:13.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:14.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:14.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:14.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:14.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:15.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:15.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:15.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:15.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:16.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:16.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:16.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:16.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:17.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:17.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:17.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:17.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:18.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:18.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:18.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:18.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:19.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:19.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:19.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:19.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:20.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:20.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:20.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:20.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:21.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:21.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:21.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:21.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:22.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:22.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:22.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:22.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:23.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:23.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:23.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:23.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:24.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:24.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:24.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:24.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:25.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:25.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:25.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:25.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:26.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:26.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:26.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:26.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:27.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:27.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:27.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:27.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:28.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:28.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:28.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:28.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:29.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:29.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:29.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:29.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:30.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:30.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:30.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:30.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:31.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:31.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:31.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:31.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:32.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:32.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:32.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:32.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:33.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:33.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:33.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:33.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:34.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:34.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:34.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:34.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:35.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:35.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:35.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:35.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:36.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:36.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:36.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:36.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:37.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:37.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:37.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:37.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:38.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:38.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:38.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:38.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:39.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:39.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:39.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:39.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:40.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:40.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:40.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:40.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:41.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:41.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:41.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:41.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:42.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:42.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:42.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:42.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:43.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:43.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:43.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:43.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:44.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:44.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:44.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:44.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:45.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:45.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:45.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:45.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:46.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:46.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:46.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:46.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:47.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:47.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:47.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:47.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:48.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:48.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:48.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:48.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:49.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:49.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:49.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:49.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:50.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:50.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:50.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:50.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:51.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:51.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:51.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:51.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:52.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:52.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:52.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:52.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:53.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:53.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:53.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:53.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:54.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:54.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:54.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:54.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:55.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:55.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:55.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:55.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:56.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:56.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:56.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:56.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:57.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:57.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:57.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:57.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:58.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:58.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:58.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:58.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:59.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:18:59.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:18:59.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:18:59.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:00.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:00.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:00.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:00.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:01.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:01.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:01.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:01.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:02.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:02.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:02.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:02.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:03.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:03.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:03.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:03.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:04.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:04.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:04.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:04.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:05.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:05.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:05.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:05.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:06.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:06.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:06.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:06.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:07.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:07.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:07.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:07.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:08.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:08.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:08.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:08.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:09.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:09.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:09.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:09.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:10.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:10.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:10.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:10.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:11.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:11.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:11.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:11.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:12.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:12.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:12.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:12.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:13.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:13.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:13.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:13.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:14.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:14.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:14.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:14.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:15.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:15.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:15.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:15.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:16.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:16.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:16.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:16.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:17.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:17.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:17.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:17.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:18.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:18.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:18.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:18.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:19.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:19.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:19.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:19.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:20.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:20.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:20.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:20.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:21.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:21.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:21.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:21.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:22.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:22.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:22.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:22.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:23.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:23.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:23.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:23.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:24.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:24.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:24.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:24.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:25.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:25.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:25.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:25.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:26.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:26.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:26.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:26.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:27.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:27.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:27.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:27.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:28.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:28.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:28.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:28.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:29.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:29.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:29.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:29.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:30.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:30.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:30.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:30.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:31.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:31.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:31.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:31.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:32.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:32.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:32.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:32.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:33.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:33.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:33.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:33.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:34.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:34.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:34.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:34.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:35.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:35.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:35.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:35.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:36.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:36.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:36.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:36.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:37.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:37.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:37.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:37.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:38.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:38.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:38.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:38.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:39.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:39.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:39.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:39.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:40.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:40.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:40.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:40.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:41.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:41.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:41.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:41.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:42.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:42.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:42.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:42.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:43.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:43.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:43.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:43.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:44.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:44.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:44.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:44.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:45.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:45.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:45.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:45.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:46.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:46.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:46.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:46.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:47.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:47.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:47.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:47.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:48.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:48.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:48.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:48.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:49.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:49.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:49.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:49.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:50.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:50.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:50.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:50.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:51.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:51.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:51.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:51.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:52.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:52.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:52.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:52.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:53.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:53.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:53.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:53.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:54.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:54.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:54.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:54.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:55.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:55.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:55.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:55.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:56.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:56.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:56.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:56.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:57.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:57.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:57.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:57.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:58.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:58.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:58.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:58.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:59.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:19:59.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:19:59.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:19:59.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:00.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:00.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:00.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:00.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:01.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:01.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:01.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:01.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:02.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:02.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:02.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:02.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:03.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:03.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:03.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:03.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:04.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:04.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:04.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:04.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:05.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:05.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:05.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:05.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:06.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:06.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:06.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:06.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:07.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:07.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:07.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:07.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:08.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:08.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:08.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:08.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:09.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:09.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:09.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:09.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:10.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:10.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:10.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:10.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:11.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:11.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:11.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:11.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:12.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:12.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:12.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:12.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:13.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:13.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:13.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:13.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:14.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:14.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:14.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:14.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:15.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:15.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:15.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:15.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:16.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:16.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:16.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:16.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:17.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:17.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:17.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:17.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:18.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:18.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:18.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:18.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:19.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:19.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:19.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:19.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:20.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:20.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:20.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:20.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:21.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:21.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:21.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:21.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:22.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:22.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:22.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:22.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:23.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:23.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:23.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:23.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:24.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:24.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:24.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:24.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:25.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:25.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:25.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:25.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:26.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:26.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:26.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:26.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:27.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:27.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:27.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:27.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:28.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:28.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:28.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:28.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:29.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:29.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:29.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:29.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:30.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:30.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:30.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:30.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:31.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:31.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:31.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:31.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:32.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:32.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:32.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:32.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:33.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:33.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:33.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:33.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:34.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:34.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:34.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:34.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:35.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:35.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:35.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:35.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:36.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:36.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:36.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:36.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:37.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:37.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:37.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:37.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:38.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:38.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:38.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:38.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:39.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:39.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:39.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:39.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:40.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:40.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:40.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:40.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:41.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:41.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:41.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:41.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:42.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:42.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:42.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:42.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:43.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:43.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:43.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:43.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:44.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:44.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:44.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:44.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:45.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:45.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:45.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:45.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:46.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:46.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:46.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:46.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:47.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:47.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:47.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:47.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:48.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:48.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:48.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:48.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:49.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:49.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:49.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:49.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:50.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:50.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:50.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:50.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:51.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:51.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:51.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:51.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:52.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:52.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:52.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:52.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:53.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:53.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:53.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:53.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:54.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:54.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:54.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:54.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:55.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:55.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:55.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:55.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:56.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:56.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:56.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:56.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:57.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:57.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:57.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:57.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:58.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:58.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:58.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:58.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:59.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:20:59.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:20:59.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:20:59.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:00.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:00.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:00.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:00.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:01.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:01.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:01.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:01.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:02.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:02.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:02.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:02.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:03.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:03.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:03.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:03.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:04.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:04.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:04.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:04.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:05.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:05.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:05.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:05.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:06.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:06.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:06.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:06.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:07.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:07.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:07.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:07.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:08.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:08.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:08.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:08.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:09.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:09.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:09.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:09.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:10.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:10.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:10.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:10.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:11.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:11.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:11.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:11.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:12.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:12.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:12.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:12.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:13.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:13.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:13.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:13.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:14.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:14.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:14.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:14.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:15.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:15.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:15.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:15.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:16.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:16.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:16.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:16.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:17.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:17.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:17.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:17.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:18.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:18.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:18.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:18.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:19.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:19.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:19.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:19.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:20.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:20.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:20.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:20.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:21.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:21.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:21.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:21.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:22.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:22.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:22.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:22.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:23.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:23.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:23.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:23.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:24.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:24.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:24.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:24.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:25.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:25.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:25.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:25.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:26.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:26.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:26.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:26.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:27.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:27.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:27.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:27.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:28.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:28.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:28.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:28.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:29.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:29.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:29.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:29.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:30.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:30.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:30.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:30.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:31.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:31.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:31.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:31.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:32.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:32.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:32.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:32.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:33.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:33.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:33.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:33.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:34.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:34.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:34.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:34.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:35.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:35.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:35.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:36.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:36.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:36.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:36.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:37.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:37.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:37.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:37.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:38.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:38.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:38.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:38.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:39.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:39.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:39.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:39.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:40.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:40.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:40.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:40.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:41.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:41.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:41.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:41.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:42.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:42.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:42.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:42.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:43.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:43.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:43.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:43.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:44.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:44.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:44.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:44.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:45.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:45.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:45.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:45.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:46.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:46.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:46.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:46.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:47.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:47.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:47.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:47.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:48.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:48.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:48.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:48.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:49.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:49.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:49.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:49.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:50.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:50.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:50.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:50.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:51.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:51.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:51.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:51.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:52.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:52.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:52.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:52.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:53.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:53.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:53.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:53.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:54.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:54.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:54.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:54.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:55.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:55.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:55.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:55.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:56.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:56.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:56.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:56.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:57.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:57.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:57.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:57.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:58.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:58.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:58.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:58.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:59.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:21:59.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:21:59.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:21:59.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:00.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:00.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:00.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:00.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:01.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:01.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:01.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:01.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:02.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:02.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:02.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:02.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:03.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:03.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:03.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:03.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:04.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:04.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:04.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:04.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:05.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:05.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:05.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:05.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:06.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:06.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:06.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:06.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:07.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:07.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:07.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:07.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:08.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:08.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:08.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:08.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:09.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:09.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:09.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:09.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:10.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:10.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:10.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:10.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:11.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:11.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:11.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:11.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:12.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:12.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:12.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:12.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:13.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:13.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:13.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:13.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:14.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:14.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:14.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:14.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:15.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:15.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:15.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:15.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:16.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:16.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:16.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:16.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:17.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:17.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:17.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:17.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:18.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:18.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:18.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:18.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:19.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:19.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:19.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:19.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:20.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:20.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:20.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:20.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:21.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:21.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:21.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:21.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:22.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:22.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:22.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:22.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:23.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:23.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:23.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:23.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:24.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:24.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:24.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:24.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:25.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:25.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:25.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:25.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:26.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:26.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:26.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:26.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:27.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:27.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:27.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:27.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:28.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:28.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:28.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:28.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:29.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:29.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:29.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:29.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:30.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:30.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:30.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:30.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:31.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:31.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:31.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:31.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:32.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:32.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:32.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:32.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:33.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:33.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:33.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:33.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:34.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:34.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:34.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:34.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:35.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:35.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:35.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:35.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:36.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:36.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:36.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:36.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:37.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:37.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:37.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:37.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:38.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:38.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:38.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:38.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:39.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:39.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:39.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:39.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:40.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:40.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:40.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:40.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:41.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:41.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:41.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:41.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:42.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:42.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:42.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:42.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:43.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:43.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:43.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:43.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:44.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:44.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:44.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:44.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:45.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:45.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:45.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:45.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:46.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:46.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:46.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:46.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:47.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:47.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:47.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:47.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:48.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:48.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:48.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:48.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:49.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:49.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:49.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:49.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:50.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:50.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:50.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:50.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:51.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:51.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:51.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:51.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:52.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:52.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:52.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:52.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:53.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:53.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:53.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:53.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:54.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:54.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:54.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:54.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:55.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:55.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:55.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:55.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:56.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:56.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:56.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:56.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:57.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:57.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:57.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:57.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:58.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:58.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:58.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:58.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:59.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:22:59.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:22:59.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:22:59.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:00.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:00.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:00.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:00.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:01.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:01.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:01.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:01.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:02.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:02.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:02.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:02.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:03.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:03.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:03.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:03.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:04.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:04.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:04.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:04.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:05.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:05.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:05.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:05.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:06.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:06.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:06.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:06.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:07.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:07.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:07.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:07.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:08.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:08.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:08.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:08.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:09.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:09.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:09.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:09.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:10.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:10.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:10.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:10.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:11.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:11.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:11.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:11.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:12.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:12.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:12.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:12.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:13.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:13.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:13.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:13.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:14.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:14.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:14.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:14.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:15.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:15.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:15.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:15.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:16.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:16.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:16.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:16.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:17.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:17.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:17.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:17.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:18.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:18.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:18.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:18.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:19.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:19.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:19.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:19.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:20.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:20.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:20.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:20.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:21.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:21.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:21.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:21.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:22.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:22.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:22.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:22.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:23.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:23.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:23.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:23.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:24.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:24.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:24.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:24.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:25.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:25.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:25.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:25.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:26.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:26.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:26.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:26.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:27.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:27.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:27.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:27.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:28.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:28.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:28.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:28.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:29.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:29.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:29.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:29.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:30.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:30.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:30.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:30.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:31.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:31.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:31.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:31.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:32.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:32.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:32.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:32.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:33.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:33.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:33.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:33.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:34.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:34.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:34.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:34.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:35.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:35.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:35.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:35.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:36.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:36.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:36.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:36.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:37.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:37.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:37.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:37.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:38.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:38.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:38.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:38.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:39.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:39.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:39.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:39.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:40.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:40.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:40.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:40.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:41.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:41.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:41.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:41.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:42.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:42.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:42.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:42.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:43.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:43.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:43.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:43.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:44.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:44.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:44.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:44.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:45.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:45.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:45.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:45.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:46.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:46.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:46.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:46.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:47.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:47.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:47.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:47.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:48.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:48.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:48.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:48.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:49.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:49.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:49.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:49.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:50.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:50.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:50.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:50.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:51.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:51.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:51.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:51.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:52.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:52.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:52.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:52.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:53.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:53.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:53.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:53.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:54.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:54.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:54.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:54.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:55.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:55.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:55.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:55.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:56.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:56.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:56.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:56.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:57.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:57.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:57.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:57.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:58.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:58.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:58.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:58.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:59.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:23:59.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:23:59.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:23:59.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:00.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:00.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:00.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:00.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:01.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:01.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:01.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:01.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:02.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:02.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:02.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:02.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:03.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:03.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:03.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:03.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:04.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:04.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:04.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:04.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:05.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:05.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:05.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:05.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:06.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:06.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:06.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:06.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:07.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:07.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:07.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:07.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:08.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:08.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:08.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:08.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:09.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:09.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:09.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:09.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:10.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:10.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:10.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:10.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:11.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:11.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:11.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:11.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:12.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:12.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:12.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:12.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:13.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:13.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:13.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:13.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:14.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:14.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:14.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:14.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:15.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:15.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:15.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:15.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:16.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:16.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:16.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:16.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:17.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:17.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:17.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:17.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:18.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:18.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:18.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:18.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:19.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:19.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:20.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:20.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:20.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:20.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:20.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:20.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:21.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:21.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:21.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:21.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:22.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:22.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:22.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:22.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:23.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:23.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:24.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:24.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:24.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:24.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:24.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:24.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:25.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:25.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:26.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:26.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:26.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:26.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:26.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:26.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:27.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:27.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:27.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:27.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:28.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:28.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:28.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:28.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:29.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:29.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:29.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:29.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:30.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:30.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:30.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:30.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:31.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:31.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:31.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:31.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:32.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:32.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:32.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:32.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:33.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:33.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:33.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:33.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:34.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:34.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:34.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:34.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:35.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:35.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:35.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:35.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:36.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:36.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:36.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:36.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:37.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:37.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:37.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:37.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:38.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:38.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:38.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:38.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:39.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:39.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:39.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:39.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:40.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:40.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:40.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:40.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:41.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:41.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:41.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:41.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:42.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:42.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:42.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:42.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:43.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:43.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:43.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:43.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:44.343 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T23:24:44.339+0000 7f5fa3fff700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh (PID: 32818) UID: 1000 2023-05-19T23:24:44.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:44.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:44.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:44.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:45.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:45.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:45.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:45.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:46.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:46.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:46.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:46.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:47.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:47.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:47.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:47.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:48.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:48.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:48.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:48.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:49.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:49.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:49.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:49.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:50.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:50.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:50.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:50.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:51.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:51.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:51.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:51.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:52.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:52.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:53.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:53.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:53.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:53.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:54.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:54.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:54.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:54.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:54.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:54.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:55.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:55.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:55.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:55.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:56.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:56.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:56.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:56.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:57.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:57.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:58.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:57.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:58.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:58.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:59.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:24:59.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:24:59.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:24:59.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:00.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:00.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:00.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:00.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:01.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:00.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:01.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:01.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:02.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:02.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:02.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:02.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:03.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:03.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:03.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:03.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:04.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:04.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:04.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:04.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:05.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:05.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:05.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:05.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:06.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:06.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:06.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:06.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:07.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:07.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:07.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:07.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:08.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:08.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:08.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:08.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:09.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:09.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:09.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:09.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:10.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:10.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:10.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:10.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:11.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:11.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:11.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:11.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:12.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:12.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:12.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:12.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:13.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:13.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:13.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:13.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:14.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:14.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:14.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:14.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:15.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:15.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:15.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:15.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:16.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:16.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:16.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:16.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:17.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:17.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:17.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:17.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:18.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:18.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:18.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:18.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:19.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:19.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:19.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:19.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:20.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:20.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:20.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:20.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:21.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:21.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:21.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:21.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:22.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:22.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:22.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:22.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:23.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:23.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:23.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:23.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:24.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:24.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:24.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:24.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:25.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:25.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:25.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:25.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:26.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:26.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:26.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:26.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:26.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:26.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:27.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:27.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:27.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:27.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:28.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:28.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:28.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:28.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:29.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:29.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:29.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:29.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:30.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:30.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:30.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:30.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:31.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:31.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:31.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:31.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:32.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:32.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:32.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:32.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:33.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:33.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:33.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:33.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:34.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:34.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:34.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:34.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:35.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:35.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:36.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:36.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:36.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:36.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:36.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:36.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:37.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:37.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:37.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:37.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:38.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:38.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:38.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:38.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:39.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:39.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:39.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:39.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:40.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:40.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:40.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:40.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:41.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:41.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:41.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:41.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:42.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:42.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:42.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:42.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:43.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:43.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:43.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:43.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:44.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:44.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:44.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:44.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:45.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:45.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:45.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:45.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:46.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:46.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:46.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:46.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:47.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:47.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:47.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:47.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:48.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:48.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:48.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:48.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:49.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:49.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:49.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:49.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:50.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:50.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:50.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:50.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:51.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:51.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:51.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:51.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:52.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:52.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:52.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:52.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:53.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:53.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:53.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:54.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:54.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:54.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:54.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:55.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:55.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:55.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:55.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:56.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:56.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:56.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:56.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:57.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:57.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:57.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:57.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:58.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:58.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:58.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:58.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:59.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:25:59.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:25:59.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:25:59.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:00.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:00.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:00.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:00.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:01.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:01.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:01.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:01.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:02.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:02.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:02.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:02.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:03.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:03.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:03.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:03.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:04.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:04.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:04.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:04.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:05.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:05.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:05.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:05.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:06.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:06.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:06.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:07.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:07.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:07.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:07.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:08.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:08.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:08.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:08.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:09.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:09.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:09.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:09.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:10.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:10.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:10.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:10.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:11.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:11.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:11.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:11.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:12.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:12.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:12.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:12.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:13.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:13.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:13.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:13.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:14.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:14.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:14.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:14.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:15.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:15.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:15.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:15.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:16.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:16.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:16.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:16.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:17.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:17.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:17.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:17.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:18.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:18.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:18.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:18.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:19.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:19.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:19.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:19.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:20.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:20.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:20.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:20.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:21.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:21.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:21.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:21.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:22.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:22.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:22.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:22.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:23.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:23.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:23.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:23.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:24.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:24.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:24.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:24.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:25.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:25.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:25.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:25.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:26.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:26.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:26.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:26.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:27.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:27.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:27.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:27.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:28.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:28.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:28.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:28.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:29.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:29.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:29.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:29.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:30.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:30.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:30.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:30.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:31.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:31.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:31.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:31.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:32.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:32.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:32.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:32.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:33.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:33.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:33.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:33.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:34.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:34.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:34.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:34.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:35.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:35.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:35.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:35.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:36.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:36.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:36.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:36.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:37.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:37.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:37.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:37.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:38.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:38.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:38.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:38.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:39.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:39.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:39.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:39.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:40.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:40.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:40.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:40.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:41.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:41.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:41.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:41.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:42.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:42.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:42.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:42.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:43.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:43.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:43.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:43.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:44.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:44.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:44.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:44.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:45.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:45.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:45.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:45.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:46.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:46.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:46.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:46.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:47.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:47.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:47.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:47.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:48.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:48.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:48.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:48.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:49.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:49.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:49.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:49.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:50.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:50.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:50.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:50.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:51.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:51.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:51.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:51.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:52.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:52.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:52.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:52.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:53.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:53.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:53.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:53.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:54.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:54.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:54.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:54.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:55.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:55.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:56.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:56.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:56.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:56.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:56.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:56.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:57.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:57.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:57.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:57.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:58.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:58.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:58.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:58.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:59.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:26:59.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:26:59.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:26:59.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:00.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:00.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:00.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:00.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:01.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:01.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:01.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:01.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:02.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:02.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:02.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:02.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:03.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:03.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:03.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:03.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:04.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:04.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:04.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:04.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:05.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:05.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:05.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:05.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:06.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:06.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:06.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:06.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:07.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:07.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:07.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:07.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:08.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:08.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:09.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:08.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:09.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:09.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:10.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:10.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:10.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:10.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:10.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:10.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:11.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:11.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:12.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:11.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:12.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:12.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:13.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:13.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:13.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:13.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:14.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:14.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:14.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:14.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:15.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:15.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:15.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:15.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:16.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:16.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:16.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:16.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:17.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:17.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:17.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:17.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:18.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:18.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:18.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:18.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:19.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:19.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:19.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:19.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:20.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:20.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:20.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:20.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:21.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:21.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:21.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:21.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:22.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:22.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:22.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:22.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:23.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:23.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:23.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:23.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:24.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:24.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:24.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:24.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:25.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:25.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:25.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:25.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:26.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:26.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:26.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:26.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:27.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:27.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:27.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:27.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:28.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:28.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:28.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:28.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:29.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:29.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:29.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:30.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:30.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:30.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:30.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:31.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:31.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:31.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:31.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:32.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:32.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:32.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:32.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:33.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:33.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:33.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:33.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:34.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:34.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:34.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:34.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:35.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:35.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:35.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:35.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:36.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:36.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:36.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:36.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:37.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:37.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:37.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:37.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:38.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:38.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:38.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:38.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:39.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:39.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:39.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:39.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:40.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:40.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:40.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:40.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:41.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:41.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:41.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:41.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:42.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:42.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:42.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:42.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:43.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:43.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:43.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:43.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:44.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:44.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:44.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:44.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:45.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:45.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:45.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:45.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:46.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:46.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:46.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:46.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:46.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:46.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:47.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:47.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:48.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:47.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:48.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:48.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:49.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:49.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:49.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:49.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:50.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:50.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:50.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:50.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:51.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:51.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:51.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:51.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:52.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:52.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:52.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:52.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:53.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:53.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:53.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:53.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:54.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:54.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:54.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:54.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:55.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:55.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:55.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:55.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:56.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:56.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:56.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:56.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:57.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:57.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:57.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:57.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:58.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:58.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:58.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:58.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:59.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:27:59.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:27:59.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:27:59.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:00.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:00.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:00.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:00.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:01.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:01.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:01.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:01.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:02.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:02.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:02.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:02.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:03.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:03.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:03.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:03.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:04.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:04.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:04.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:04.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:05.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:05.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:05.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:05.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:06.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:06.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:06.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:06.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:07.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:07.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:07.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:07.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:08.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:08.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:08.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:08.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:09.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:09.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:09.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:09.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:10.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:10.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:10.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:10.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:11.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:11.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:11.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:11.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:12.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:12.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:12.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:12.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:13.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:13.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:13.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:13.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:14.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:14.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:14.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:14.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:15.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:15.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:15.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:15.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:16.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:16.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:16.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:16.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:17.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:17.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:17.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:17.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:18.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:18.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:18.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:18.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:19.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:19.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:19.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:19.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:20.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:20.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:20.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:20.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:21.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:21.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:21.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:21.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:22.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:22.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:22.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:22.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:23.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:23.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:23.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:23.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:24.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:24.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:24.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:24.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:25.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:25.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:25.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:25.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:26.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:26.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:26.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:26.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:27.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:27.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:27.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:27.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:28.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:28.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:28.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:28.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:29.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:29.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:29.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:29.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:30.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:30.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:30.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:30.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:31.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:31.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:31.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:31.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:32.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:32.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:32.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:32.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:33.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:33.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:33.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:33.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:34.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:34.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:34.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:34.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:35.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:35.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:35.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:35.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:36.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:36.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:36.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:36.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:37.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:37.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:37.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:37.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:38.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:38.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:38.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:38.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:39.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:39.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:39.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:39.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:40.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:40.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:40.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:40.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:41.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:41.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:41.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:41.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:42.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:42.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:42.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:42.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:43.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:43.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:43.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:43.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:44.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:44.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:44.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:44.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:45.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:45.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:45.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:45.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:46.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:46.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:46.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:46.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:47.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:47.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:47.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:47.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:48.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:48.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:48.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:48.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:49.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:49.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:49.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:49.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:50.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:50.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:50.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:50.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:51.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:51.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:51.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:51.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:52.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:52.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:52.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:52.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:53.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:53.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:53.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:53.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:54.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:54.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:54.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:54.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:55.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:55.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:55.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:55.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:56.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:56.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:56.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:56.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:57.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:57.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:57.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:57.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:58.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:58.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:58.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:58.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:59.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:28:59.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:28:59.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:28:59.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:00.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:00.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:00.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:00.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:01.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:01.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:01.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:01.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:02.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:02.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:02.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:02.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:03.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:03.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:03.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:03.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:04.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:04.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:04.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:04.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:05.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:05.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:05.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:05.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:06.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:06.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:06.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:06.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:07.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:07.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:07.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:07.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:08.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:08.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:08.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:08.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:09.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:09.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:09.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:09.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:10.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:10.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:10.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:10.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:11.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:11.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:11.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:11.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:12.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:12.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:12.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:12.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:13.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:13.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:13.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:13.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:14.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:14.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:14.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:14.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:15.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:15.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:15.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:15.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:16.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:16.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:16.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:16.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:17.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:17.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:17.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:17.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:18.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:18.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:18.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:18.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:19.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:19.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:19.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:19.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:20.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:20.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:20.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:20.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:21.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:21.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:21.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:21.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:22.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:22.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:22.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:22.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:23.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:23.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:23.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:23.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:24.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:24.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:24.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:24.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:25.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:25.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:25.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:25.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:26.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:26.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:26.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:26.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:27.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:27.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:27.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:27.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:28.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:28.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:28.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:28.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:29.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:29.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:30.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:30.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:30.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:30.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:31.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:30.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:31.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:31.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:32.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:32.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:32.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:32.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:33.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:33.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:33.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:33.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:34.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:34.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:34.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:34.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:34.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:34.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:35.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:35.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:36.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:36.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:36.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:36.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:37.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:37.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:37.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:37.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:38.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:38.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:38.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:38.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:39.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:39.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:39.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:39.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:40.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:40.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:40.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:40.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:41.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:41.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:41.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:41.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:41.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:41.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:42.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:42.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:43.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:43.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:43.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:43.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:44.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:44.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:44.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:44.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:45.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:45.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:45.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:45.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:46.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:46.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:46.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:46.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:47.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:47.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:47.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:47.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:47.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:47.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:48.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:48.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:48.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:48.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:49.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:49.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:49.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:49.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:50.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:50.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:50.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:50.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:51.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:51.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:51.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:51.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:52.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:52.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:52.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:52.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:53.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:53.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:53.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:53.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:54.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:54.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:54.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:54.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:55.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:55.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:56.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:56.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:56.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:56.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:56.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:56.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:57.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:57.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:57.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:57.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:58.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:58.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:59.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:59.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:59.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:29:59.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:29:59.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:29:59.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:00.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:00.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:00.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:00.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:01.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:01.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:01.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:01.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:02.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:02.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:02.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:02.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:03.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:03.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:03.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:03.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:04.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:04.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:04.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:04.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:05.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:05.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:05.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:05.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:06.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:06.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:06.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:06.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:07.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:07.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:07.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:07.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:08.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:08.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:08.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:08.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:09.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:09.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:09.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:09.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:10.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:10.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:10.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:10.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:11.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:11.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:11.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:11.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:12.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:12.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:13.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:12.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:13.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:13.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:13.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:13.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:14.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:14.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:14.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:14.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:15.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:15.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:15.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:15.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:16.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:16.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:16.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:16.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:17.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:17.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:17.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:17.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:18.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:18.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:18.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:18.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:19.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:19.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:19.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:19.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:20.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:20.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:21.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:21.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:21.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:21.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:22.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:22.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:22.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:22.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:23.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:23.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:23.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:23.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:24.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:24.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:24.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:24.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:25.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:25.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:25.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:25.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:26.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:26.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:26.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:26.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:27.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:27.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:27.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:27.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:28.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:28.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:28.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:28.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:29.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:29.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:29.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:29.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:30.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:30.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:30.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:30.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:31.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:31.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:31.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:31.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:32.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:32.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:32.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:32.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:33.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:33.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:33.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:33.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:34.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:34.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:34.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:34.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:35.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:35.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:35.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:35.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:36.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:36.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:36.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:36.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:37.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:37.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:37.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:37.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:38.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:38.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:38.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:38.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:39.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:39.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:39.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:39.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:40.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:40.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:40.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:40.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:41.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:41.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:41.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:41.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:42.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:42.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:42.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:42.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:43.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:43.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:43.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:43.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:44.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:44.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:44.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:44.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:45.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:45.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:45.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:45.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:46.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:46.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:46.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:46.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:47.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:47.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:47.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:47.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:48.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:48.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:48.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:48.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:49.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:49.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:49.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:49.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:50.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:50.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:50.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:50.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:51.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:51.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:51.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:51.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:52.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:52.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:52.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:52.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:53.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:53.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:53.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:53.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:54.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:54.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:54.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:54.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:55.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:55.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:55.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:55.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:56.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:56.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:56.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:56.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:57.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:57.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:57.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:57.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:58.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:58.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:58.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:58.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:59.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:30:59.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:30:59.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:30:59.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:00.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:00.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:00.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:00.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:01.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:01.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:01.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:01.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:02.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:02.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:02.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:02.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:03.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:03.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:03.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:03.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:04.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:04.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:04.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:04.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:05.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:05.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:05.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:05.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:06.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:06.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:06.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:06.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:07.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:07.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:07.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:07.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:08.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:08.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:08.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:08.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:09.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:09.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:09.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:09.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:10.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:10.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:10.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:10.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:11.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:11.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:11.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:11.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:12.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:12.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:12.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:12.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:13.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:13.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:13.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:13.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:14.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:14.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:14.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:14.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:15.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:15.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:15.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:15.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:16.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:16.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:16.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:16.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:17.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:17.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:17.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:17.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:18.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:18.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:18.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:18.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:19.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:19.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:19.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:19.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:20.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:20.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:20.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:20.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:21.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:21.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:21.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:21.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:22.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:22.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:22.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:22.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:23.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:23.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:23.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:23.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:24.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:24.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:24.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:24.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:25.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:25.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:25.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:25.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:26.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:26.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:26.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:26.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:27.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:27.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:27.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:27.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:28.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:28.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:28.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:28.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:29.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:29.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:29.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:29.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:30.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:30.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:30.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:30.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:31.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:31.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:31.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:31.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:32.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:32.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:32.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:32.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:33.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:33.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:33.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:33.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:34.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:34.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:34.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:34.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:35.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:35.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:35.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:35.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:36.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:36.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:36.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:36.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:37.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:37.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:37.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:37.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:38.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:38.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:38.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:38.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:39.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:39.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:39.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:39.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:40.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:40.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:40.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:40.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:41.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:41.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:41.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:41.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:42.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:42.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:42.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:42.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:43.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:43.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:43.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:43.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:44.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:44.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:44.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:44.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:45.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:45.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:45.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:45.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:46.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:46.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:46.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:46.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:47.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:47.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:47.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:47.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:48.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:48.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:48.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:48.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:49.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:49.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:49.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:49.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:50.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:50.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:50.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:50.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:51.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:51.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:51.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:51.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:52.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:52.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:52.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:52.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:53.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:53.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:53.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:53.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:54.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:54.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:54.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:54.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:55.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:55.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:55.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:55.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:56.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:56.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:56.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:56.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:57.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:57.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:57.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:57.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:58.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:58.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:58.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:58.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:59.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:31:59.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:31:59.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:31:59.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:00.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:00.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:00.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:00.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:01.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:01.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:01.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:01.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:02.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:02.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:02.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:02.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:03.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:03.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:03.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:03.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:04.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:04.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:04.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:04.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:05.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:05.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:05.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:05.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:06.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:06.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:06.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:06.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:07.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:07.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:07.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:07.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:08.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:08.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:08.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:08.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:09.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:09.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:09.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:09.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:10.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:10.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:10.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:10.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:11.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:11.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:11.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:11.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:12.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:12.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:12.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:12.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:13.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:13.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:13.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:13.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:14.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:14.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:14.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:14.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:15.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:15.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:15.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:15.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:16.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:16.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:16.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:16.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:17.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:17.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:17.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:17.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:18.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:18.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:18.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:18.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:19.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:19.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:19.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:19.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:20.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:20.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:20.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:20.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:21.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:21.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:21.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:21.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:22.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:22.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:22.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:22.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:23.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:23.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:23.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:23.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:24.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:24.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:24.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:24.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:25.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:25.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:25.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:25.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:26.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:26.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:26.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:26.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:27.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:27.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:27.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:27.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:28.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:28.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:28.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:28.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:29.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:29.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:29.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:29.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:30.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:30.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:30.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:30.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:31.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:31.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:31.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:31.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:32.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:32.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:32.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:32.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:33.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:33.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:33.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:33.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:34.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:34.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:34.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:34.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:35.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:35.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:35.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:35.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:36.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:36.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:36.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:36.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:37.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:37.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:37.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:37.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:38.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:38.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:38.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:38.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:39.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:39.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:39.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:39.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:40.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:40.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:40.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:40.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:41.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:41.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:41.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:41.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:42.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:42.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:42.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:42.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:43.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:43.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:43.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:43.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:44.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:44.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:44.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:44.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:45.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:45.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:45.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:45.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:46.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:46.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:46.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:46.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:47.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:47.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:47.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:47.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:48.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:48.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:48.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:48.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:49.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:49.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:49.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:49.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:50.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:50.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:50.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:50.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:51.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:51.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:51.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:51.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:52.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:52.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:52.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:52.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:53.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:53.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:53.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:53.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:54.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:54.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:54.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:54.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:55.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:55.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:55.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:55.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:56.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:56.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:56.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:56.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:57.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:57.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:57.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:57.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:58.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:58.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:58.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:58.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:59.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:32:59.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:32:59.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:32:59.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:00.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:00.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:00.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:00.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:01.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:01.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:01.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:01.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:02.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:02.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:02.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:02.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:03.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:03.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:03.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:03.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:04.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:04.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:04.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:04.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:05.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:05.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:05.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:05.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:06.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:06.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:06.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:06.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:07.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:07.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:07.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:07.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:08.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:08.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:08.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:08.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:09.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:09.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:09.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:09.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:10.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:10.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:10.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:10.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:11.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:11.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:11.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:11.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:12.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:12.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:12.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:12.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:13.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:13.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:13.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:13.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:14.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:14.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:14.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:14.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:15.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:15.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:15.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:15.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:16.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:16.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:16.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:16.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:17.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:17.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:17.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:17.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:18.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:18.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:19.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:19.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:19.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:19.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:20.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:20.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:20.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:20.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:21.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:21.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:21.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:21.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:22.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:22.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:22.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:22.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:23.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:23.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:23.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:23.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:24.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:24.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:24.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:24.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:25.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:25.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:25.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:25.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:26.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:26.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:26.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:26.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:27.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:27.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:27.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:27.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:28.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:28.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:28.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:28.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:29.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:29.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:29.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:29.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:30.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:30.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:30.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:30.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:31.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:31.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:31.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:31.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:32.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:32.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:32.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:32.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:33.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:33.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:33.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:33.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:34.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:34.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:34.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:34.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:35.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:35.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:35.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:35.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:36.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:36.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:36.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:36.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:37.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:37.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:37.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:37.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:38.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:38.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:38.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:38.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:39.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:39.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:39.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:39.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:40.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:40.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:40.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:40.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:41.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:41.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:41.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:41.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:42.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:42.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:42.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:42.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:43.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:43.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:43.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:43.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:44.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:44.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:44.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:44.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:45.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:45.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:45.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:45.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:46.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:46.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:46.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:47.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:47.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:47.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:47.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:48.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:48.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:48.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:48.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:49.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:49.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:49.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:49.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:50.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:50.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:50.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:50.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:51.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:51.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:51.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:51.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:52.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:52.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:52.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:52.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:53.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:53.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:53.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:53.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:54.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:54.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:54.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:54.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:55.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:55.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:55.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:55.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:56.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:56.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:56.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:56.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:57.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:57.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:57.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:57.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:58.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:58.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:58.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:58.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:59.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:33:59.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:33:59.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:33:59.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:00.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:00.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:00.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:00.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:01.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:01.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:01.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:01.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:02.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:02.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:02.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:02.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:03.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:03.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:03.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:03.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:04.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:04.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:04.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:04.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:05.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:05.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:05.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:05.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:06.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:06.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:06.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:06.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:07.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:07.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:07.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:07.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:08.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:08.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:08.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:08.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:09.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:09.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:09.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:09.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:10.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:10.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:10.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:10.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:11.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:11.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:11.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:11.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:12.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:12.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:12.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:12.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:13.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:13.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:13.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:13.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:14.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:14.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:14.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:14.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:15.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:15.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:15.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:15.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:16.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:16.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:16.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:16.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:17.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:17.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:17.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:17.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:18.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:18.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:18.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:18.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:19.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:19.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:19.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:19.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:20.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:20.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:20.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:20.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:21.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:21.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:21.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:21.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:22.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:22.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:22.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:22.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:23.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:23.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:23.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:23.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:24.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:24.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:24.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:24.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:25.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:25.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:25.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:25.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:26.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:26.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:26.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:26.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:27.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:27.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:27.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:27.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:28.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:28.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:28.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:28.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:29.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:29.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:29.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:29.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:30.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:30.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:30.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:30.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:31.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:31.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:31.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:31.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:32.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:32.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:32.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:32.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:33.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:33.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:33.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:33.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:34.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:34.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:34.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:34.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:35.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:35.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:35.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:35.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:36.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:36.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:36.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:36.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:37.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:37.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:37.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:37.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:38.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:38.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:38.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:38.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:39.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:39.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:39.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:39.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:40.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:40.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:40.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:40.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:41.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:41.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:41.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:41.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:42.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:42.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:42.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:42.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:43.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:43.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:43.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:43.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:44.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:44.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:44.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:44.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:45.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:45.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:45.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:45.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:46.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:46.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:46.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:46.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:47.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:47.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:47.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:47.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:48.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:48.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:48.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:48.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:49.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:49.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:49.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:49.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:50.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:50.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:50.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:50.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:51.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:51.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:51.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:51.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:52.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:52.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:52.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:52.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:53.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:53.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:53.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:53.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:54.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:54.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:54.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:54.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:55.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:55.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:55.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:55.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:56.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:56.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:56.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:56.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:57.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:57.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:57.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:57.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:58.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:58.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:58.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:58.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:59.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:34:59.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:34:59.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:34:59.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:00.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:00.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:00.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:00.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:01.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:01.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:01.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:01.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:02.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:02.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:02.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:02.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:03.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:03.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:03.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:03.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:04.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:04.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:04.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:04.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:05.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:05.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:05.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:05.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:06.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:06.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:06.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:06.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:07.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:07.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:07.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:07.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:08.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:08.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:08.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:08.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:09.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:09.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:09.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:09.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:10.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:10.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:10.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:10.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:11.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:11.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:11.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:11.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:12.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:12.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:12.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:12.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:13.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:13.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:13.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:13.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:14.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:14.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:14.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:14.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:15.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:15.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:15.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:15.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:16.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:16.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:16.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:16.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:17.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:17.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:17.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:17.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:18.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:18.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:18.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:18.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:19.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:19.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:19.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:19.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:20.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:20.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:20.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:20.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:21.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:21.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:21.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:21.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:22.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:22.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:22.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:22.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:23.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:23.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:23.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:23.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:24.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:24.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:24.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:24.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:25.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:25.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:25.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:25.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:26.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:26.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:26.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:26.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:27.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:27.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:27.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:27.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:28.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:28.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:28.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:28.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:29.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:29.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:29.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:29.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:30.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:30.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:30.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:30.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:31.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:31.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:31.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:31.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:32.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:32.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:32.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:32.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:33.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:33.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:33.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:33.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:34.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:34.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:34.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:34.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:35.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:35.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:35.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:35.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:36.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:36.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:36.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:36.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:37.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:37.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:37.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:37.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:38.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:38.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:38.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:38.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:39.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:39.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:39.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:39.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:40.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:40.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:40.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:40.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:41.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:41.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:41.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:41.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:42.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:42.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:42.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:42.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:43.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:43.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:43.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:43.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:44.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:44.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:44.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:44.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:45.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:45.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:45.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:45.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:46.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:46.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:46.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:46.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:47.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:47.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:47.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:47.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:48.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:48.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:48.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:48.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:49.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:49.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:49.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:49.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:50.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:50.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:50.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:50.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:51.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:51.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:51.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:51.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:52.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:52.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:52.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:52.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:53.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:53.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:53.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:53.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:54.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:54.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:54.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:54.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:55.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:55.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:55.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:55.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:56.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:56.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:56.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:56.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:57.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:57.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:57.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:57.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:58.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:58.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:58.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:58.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:59.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:35:59.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:35:59.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:35:59.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:00.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:00.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:00.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:00.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:01.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:01.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:01.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:01.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:02.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:02.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:02.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:02.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:03.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:03.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:03.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:03.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:04.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:04.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:04.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:04.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:05.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:05.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:05.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:05.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:06.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:06.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:06.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:06.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:07.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:07.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:07.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:07.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:08.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:08.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:08.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:08.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:09.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:09.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:09.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:09.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:10.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:10.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:10.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:10.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:11.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:11.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:11.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:11.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:12.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:12.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:12.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:12.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:13.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:13.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:13.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:13.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:14.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:14.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:14.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:14.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:15.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:15.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:15.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:15.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:16.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:16.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:16.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:16.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:17.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:17.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:17.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:17.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:18.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:18.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:18.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:18.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:19.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:19.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:19.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:19.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:20.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:20.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:20.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:20.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:21.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:21.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:21.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:21.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:22.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:22.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:22.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:22.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:23.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:23.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:23.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:23.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:24.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:24.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:24.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:24.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:25.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:25.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:25.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:25.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:26.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:26.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:26.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:26.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:27.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:27.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:27.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:27.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:28.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:28.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:28.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:28.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:29.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:29.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:29.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:29.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:30.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:30.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:30.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:30.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:31.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:31.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:31.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:31.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:32.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:32.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:32.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:32.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:33.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:33.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:33.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:33.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:34.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:34.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:34.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:34.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:35.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:35.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:35.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:35.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:36.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:36.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:36.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:36.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:37.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:37.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:37.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:37.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:38.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:38.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:38.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:38.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:39.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:39.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:39.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:39.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:40.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:40.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:40.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:40.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:41.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:41.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:41.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:41.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:42.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:42.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:42.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:42.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:43.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:43.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:43.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:43.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:44.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:44.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:44.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:44.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:45.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:45.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:45.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:45.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:46.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:46.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:46.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:46.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:47.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:47.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:47.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:47.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:48.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:48.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:48.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:48.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:49.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:49.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:49.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:49.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:50.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:50.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:50.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:50.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:51.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:51.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:51.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:51.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:52.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:52.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:52.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:52.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:53.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:53.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:53.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:53.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:54.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:54.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:54.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:54.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:55.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:55.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:55.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:55.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:56.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:56.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:56.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:56.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:57.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:57.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:57.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:57.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:58.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:58.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:58.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:58.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:59.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:36:59.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:36:59.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:36:59.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:00.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:00.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:00.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:00.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:01.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:01.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:01.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:01.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:02.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:02.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:02.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:02.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:03.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:03.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:03.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:03.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:04.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:04.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:04.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:04.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:05.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:05.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:05.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:05.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:06.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:06.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:06.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:06.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:07.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:07.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:07.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:07.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:08.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:08.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:08.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:08.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:09.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:09.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:09.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:09.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:10.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:10.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:10.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:10.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:11.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:11.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:11.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:11.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:12.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:12.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:12.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:12.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:13.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:13.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:13.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:13.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:14.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:14.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:14.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:14.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:15.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:15.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:15.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:15.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:16.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:16.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:16.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:16.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:17.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:17.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:17.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:17.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:18.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:18.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:18.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:18.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:19.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:19.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:19.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:19.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:20.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:20.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:20.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:20.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:21.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:21.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:21.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:21.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:22.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:22.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:22.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:22.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:23.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:23.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:23.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:23.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:24.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:24.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:24.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:24.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:25.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:25.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:25.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:25.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:26.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:26.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:26.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:26.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:27.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:27.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:27.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:27.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:28.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:28.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:28.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:28.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:29.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:29.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:29.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:29.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:30.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:30.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:30.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:30.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:31.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:31.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:31.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:31.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:32.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:32.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:32.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:32.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:33.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:33.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:33.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:33.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:34.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:34.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:34.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:34.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:35.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:35.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:35.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:35.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:36.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:36.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:36.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:36.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:37.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:37.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:37.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:37.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:38.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:38.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:38.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:38.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:39.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:39.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:39.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:39.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:40.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:40.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:40.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:40.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:41.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:41.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:41.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:41.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:42.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:42.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:42.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:42.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:43.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:43.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:43.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:43.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:44.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:44.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:44.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:44.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:45.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:45.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:45.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:45.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:46.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:46.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:46.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:46.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:47.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:47.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:47.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:47.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:48.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:48.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:48.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:48.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:49.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:49.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:49.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:49.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:50.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:50.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:50.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:50.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:51.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:51.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:51.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:51.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:52.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:52.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:52.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:52.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:53.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:53.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:53.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:53.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:54.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:54.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:54.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:54.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:55.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:55.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:55.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:55.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:56.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:56.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:56.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:56.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:57.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:57.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:57.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:57.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:58.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:58.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:58.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:58.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:59.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:37:59.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:37:59.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:37:59.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:00.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:00.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:00.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:00.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:01.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:01.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:01.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:01.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:02.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:02.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:02.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:02.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:03.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:03.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:03.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:03.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:04.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:04.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:04.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:04.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:05.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:05.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:05.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:05.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:06.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:06.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:06.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:06.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:07.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:07.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:07.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:07.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:08.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:08.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:08.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:08.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:09.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:09.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:09.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:09.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:10.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:10.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:10.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:10.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:11.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:11.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:11.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:11.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:12.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:12.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:12.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:12.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:13.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:13.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:13.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:13.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:14.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:14.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:14.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:14.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:15.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:15.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:15.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:15.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:16.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:16.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:16.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:16.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:17.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:17.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:17.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:17.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:18.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:18.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:18.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:18.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:19.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:19.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:19.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:19.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:20.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:20.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:20.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:20.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:21.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:21.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:21.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:21.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:22.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:22.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:22.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:22.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:23.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:23.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:23.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:23.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:24.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:24.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:24.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:24.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:25.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:25.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:25.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:25.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:26.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:26.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:26.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:26.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:27.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:27.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:27.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:27.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:28.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:28.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:28.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:28.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:29.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:29.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:29.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:29.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:30.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:30.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:30.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:30.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:31.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:31.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:31.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:31.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:32.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:32.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:32.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:32.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:33.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:33.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:33.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:33.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:34.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:34.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:34.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:34.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:35.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:35.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:35.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:35.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:36.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:36.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:36.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:36.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:37.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:37.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:37.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:37.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:38.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:38.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:38.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:38.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:39.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:39.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:39.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:39.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:40.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:40.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:41.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:41.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:41.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:41.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:42.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:42.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:42.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:42.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:43.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:43.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:43.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:43.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:43.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:43.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:44.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:44.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:44.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:44.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:45.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:45.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:45.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:45.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:46.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:46.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:46.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:46.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:47.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:47.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:47.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:47.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:48.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:48.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:48.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:48.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:49.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:49.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:49.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:49.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:50.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:50.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:50.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:50.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:51.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:51.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:51.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:51.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:52.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:52.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:52.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:52.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:53.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:53.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:53.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:53.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:54.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:54.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:54.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:54.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:55.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:55.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:55.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:55.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:56.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:56.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:56.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:56.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:57.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:57.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:57.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:57.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:58.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:58.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:59.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:59.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:59.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:38:59.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:38:59.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:38:59.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:00.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:00.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:01.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:01.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:01.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:01.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:01.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:01.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:02.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:02.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:02.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:02.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:03.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:03.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:04.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:04.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:04.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:04.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:05.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:04.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:05.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:05.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:06.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:06.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:06.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:06.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:07.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:07.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:07.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:07.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:08.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:08.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:08.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:08.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:09.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:09.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:09.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:09.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:10.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:10.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:10.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:10.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:11.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:11.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:11.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:11.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:12.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:12.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:12.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:12.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:13.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:13.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:13.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:13.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:14.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:14.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:14.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:14.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:15.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:15.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:16.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:16.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:16.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:16.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:17.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:17.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:17.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:17.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:18.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:18.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:18.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:18.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:19.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:19.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:19.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:19.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:20.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:20.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:20.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:20.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:21.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:21.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:21.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:21.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:21.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:21.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:22.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:22.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:22.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:22.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:23.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:23.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:23.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:23.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:24.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:24.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:24.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:24.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:25.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:25.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:25.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:25.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:26.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:26.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:26.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:26.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:27.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:27.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:27.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:27.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:28.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:28.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:28.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:28.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:29.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:29.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:29.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:29.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:30.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:30.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:30.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:30.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:31.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:31.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:32.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:32.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:32.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:32.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:32.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:32.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:33.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:33.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:33.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:33.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:34.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:34.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:35.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:34.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:35.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:35.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:36.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:35.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:36.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:36.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:36.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:36.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:37.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:37.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:37.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:37.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:38.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:38.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:38.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:38.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:39.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:39.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:39.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:39.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:40.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:40.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:40.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:40.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:41.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:41.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:41.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:41.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:42.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:42.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:42.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:42.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:43.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:43.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:43.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:43.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:44.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:44.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:44.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:44.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:45.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:45.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:45.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:45.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:46.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:46.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:46.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:46.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:47.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:47.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:47.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:47.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:48.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:48.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:48.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:48.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:49.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:49.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:49.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:49.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:50.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:50.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:50.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:50.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:51.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:51.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:51.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:51.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:51.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:51.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:52.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:52.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:53.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:53.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:53.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:53.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:54.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:54.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:54.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:54.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:55.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:55.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:55.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:55.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:56.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:56.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:56.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:56.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:57.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:57.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:57.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:57.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:58.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:58.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:58.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:58.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:59.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:39:59.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:39:59.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:39:59.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:00.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:00.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:00.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:00.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:01.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:01.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:01.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:01.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:02.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:02.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:02.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:02.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:03.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:03.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:03.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:03.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:04.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:04.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:04.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:04.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:05.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:05.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:05.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:05.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:06.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:06.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:06.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:06.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:07.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:07.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:07.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:07.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:08.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:08.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:08.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:08.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:09.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:09.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:09.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:09.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:10.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:10.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:10.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:10.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:11.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:11.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:11.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:11.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:12.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:12.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:12.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:12.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:13.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:13.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:13.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:13.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:14.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:14.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:14.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:14.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:15.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:15.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:15.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:15.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:16.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:16.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:16.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:16.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:17.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:17.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:17.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:17.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:18.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:18.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:18.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:18.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:19.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:19.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:20.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:20.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:20.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:20.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:21.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:21.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:21.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:21.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:22.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:22.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:22.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:22.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:23.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:23.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:23.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:23.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:24.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:24.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:24.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:24.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:25.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:25.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:25.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:25.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:26.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:26.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:26.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:26.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:27.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:27.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:27.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:27.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:28.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:28.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:28.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:28.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:29.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:29.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:29.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:29.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:30.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:30.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:30.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:30.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:31.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:31.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:31.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:31.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:32.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:32.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:32.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:32.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:33.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:33.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:33.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:33.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:34.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:34.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:34.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:34.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:35.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:35.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:35.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:35.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:36.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:36.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:36.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:36.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:37.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:37.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:37.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:37.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:38.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:38.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:38.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:38.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:39.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:39.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:39.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:39.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:40.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:40.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:40.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:40.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:41.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:41.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:41.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:41.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:42.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:42.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:42.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:42.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:43.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:43.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:43.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:43.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:44.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:44.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:44.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:44.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:45.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:45.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:45.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:45.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:46.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:46.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:46.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:46.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:47.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:47.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:47.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:47.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:48.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:48.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:48.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:48.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:49.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:49.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:49.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:49.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:50.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:50.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:50.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:50.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:51.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:51.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:51.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:51.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:52.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:52.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:52.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:52.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:53.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:53.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:53.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:53.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:54.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:54.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:54.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:54.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:55.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:55.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:55.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:55.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:56.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:56.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:56.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:56.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:57.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:57.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:57.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:57.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:58.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:58.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:58.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:58.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:59.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:40:59.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:40:59.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:40:59.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:00.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:00.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:00.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:00.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:01.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:01.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:01.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:01.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:02.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:02.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:02.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:02.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:03.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:03.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:03.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:03.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:04.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:04.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:04.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:04.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:05.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:05.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:05.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:05.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:06.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:06.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:06.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:06.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:07.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:07.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:07.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:07.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:08.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:08.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:08.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:08.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:09.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:09.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:09.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:09.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:10.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:10.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:10.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:10.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:11.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:11.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:11.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:11.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:12.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:12.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:12.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:12.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:13.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:13.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:13.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:13.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:14.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:14.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:14.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:14.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:15.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:15.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:15.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:15.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:16.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:16.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:16.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:16.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:17.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:17.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:17.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:17.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:18.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:18.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:18.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:18.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:19.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:19.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:19.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:19.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:20.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:20.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:20.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:20.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:21.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:21.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:21.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:21.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:22.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:22.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:22.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:22.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:23.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:23.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:23.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:23.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:24.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:24.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:24.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:24.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:25.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:25.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:25.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:25.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:26.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:26.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:26.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:26.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:27.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:27.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:27.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:27.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:28.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:28.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:28.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:28.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:29.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:29.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:29.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:29.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:30.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:30.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:30.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:30.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:31.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:31.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:31.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:31.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:32.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:32.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:32.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:32.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:33.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:33.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:33.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:33.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:34.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:34.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:34.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:34.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:35.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:35.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:35.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:35.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:36.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:36.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:36.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:36.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:37.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:37.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:37.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:37.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:38.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:38.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:38.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:38.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:39.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:39.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:39.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:39.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:40.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:40.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:40.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:40.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:41.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:41.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:41.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:41.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:42.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:42.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:42.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:42.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:43.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:43.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:43.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:43.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:44.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:44.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:44.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:44.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:45.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:45.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:45.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:45.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:46.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:46.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:46.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:46.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:47.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:47.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:47.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:47.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:48.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:48.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:48.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:48.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:49.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:49.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:49.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:49.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:50.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:50.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:50.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:50.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:51.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:51.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:51.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:51.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:52.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:52.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:52.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:52.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:53.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:53.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:53.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:53.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:54.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:54.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:54.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:54.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:55.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:55.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:55.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:55.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:56.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:56.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:56.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:56.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:57.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:57.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:57.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:57.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:58.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:58.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:58.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:58.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:59.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:41:59.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:41:59.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:41:59.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:00.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:00.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:00.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:00.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:01.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:01.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:01.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:01.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:02.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:02.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:02.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:02.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:03.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:03.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:03.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:03.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:04.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:04.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:04.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:04.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:05.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:05.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:05.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:05.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:06.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:06.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:06.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:06.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:07.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:07.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:07.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:07.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:08.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:08.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:08.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:08.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:09.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:09.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:09.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:09.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:10.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:10.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:10.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:10.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:11.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:11.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:11.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:11.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:12.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:12.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:12.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:12.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:13.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:13.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:13.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:13.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:14.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:14.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:14.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:14.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:15.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:15.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:15.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:15.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:16.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:16.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:16.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:16.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:17.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:17.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:17.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:17.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:18.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:18.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:18.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:18.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:19.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:19.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:19.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:19.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:20.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:20.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:20.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:20.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:21.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:21.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:21.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:21.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:22.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:22.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:22.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:22.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:23.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:23.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:23.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:23.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:24.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:24.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:24.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:24.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:25.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:25.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:25.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:25.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:26.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:26.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:26.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:26.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:27.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:27.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:27.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:27.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:28.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:28.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:28.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:28.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:29.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:29.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:29.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:29.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:30.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:30.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:30.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:30.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:31.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:31.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:31.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:31.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:32.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:32.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:32.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:32.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:33.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:33.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:33.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:33.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:34.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:34.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:34.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:34.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:35.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:35.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:35.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:35.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:36.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:36.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:36.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:36.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:37.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:37.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:37.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:37.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:38.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:38.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:38.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:38.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:39.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:39.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:39.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:39.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:40.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:40.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:40.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:40.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:41.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:41.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:41.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:41.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:42.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:42.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:42.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:42.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:43.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:43.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:43.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:43.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:44.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:44.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:44.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:44.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:45.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:45.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:45.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:45.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:46.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:46.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:46.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:46.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:47.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:47.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:47.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:47.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:48.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:48.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:48.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:48.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:49.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:49.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:49.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:49.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:50.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:50.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:50.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:50.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:51.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:51.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:51.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:51.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:52.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:52.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:52.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:52.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:53.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:53.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:53.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:53.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:54.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:54.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:54.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:54.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:55.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:55.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:55.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:55.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:56.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:56.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:56.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:56.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:57.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:57.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:57.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:57.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:58.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:58.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:58.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:58.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:59.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:42:59.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:42:59.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:42:59.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:00.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:00.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:00.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:00.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:01.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:01.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:01.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:01.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:02.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:02.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:02.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:02.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:03.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:03.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:03.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:03.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:04.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:04.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:04.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:04.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:05.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:05.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:05.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:05.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:06.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:06.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:06.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:06.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:07.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:07.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:07.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:07.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:08.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:08.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:08.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:08.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:09.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:09.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:09.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:09.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:10.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:10.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:10.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:10.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:11.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:11.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:11.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:11.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:12.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:12.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:12.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:12.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:13.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:13.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:13.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:13.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:14.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:14.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:14.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:14.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:15.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:15.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:15.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:15.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:16.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:16.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:16.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:16.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:17.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:17.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:17.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:17.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:18.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:18.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:18.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:18.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:19.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:19.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:19.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:19.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:20.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:20.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:20.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:20.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:21.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:21.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:21.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:21.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:22.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:22.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:22.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:22.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:23.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:23.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:23.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:23.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:24.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:24.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:24.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:24.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:25.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:25.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:25.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:25.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:26.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:26.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:26.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:26.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:27.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:27.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:27.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:27.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:28.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:28.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:28.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:28.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:29.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:29.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:29.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:29.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:30.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:30.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:30.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:30.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:31.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:31.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:31.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:31.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:32.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:32.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:32.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:32.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:33.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:33.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:33.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:33.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:34.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:34.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:34.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:34.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:35.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:35.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:35.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:35.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:36.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:36.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:36.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:36.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:37.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:37.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:37.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:37.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:38.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:38.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:38.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:38.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:39.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:39.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:39.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:39.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:40.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:40.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:40.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:40.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:41.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:41.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:41.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:41.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:42.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:42.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:42.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:42.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:43.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:43.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:43.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:43.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:44.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:44.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:44.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:44.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:45.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:45.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:45.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:45.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:46.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:46.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:46.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:46.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:47.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:47.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:47.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:47.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:48.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:48.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:48.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:48.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:49.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:49.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:49.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:49.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:50.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:50.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:50.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:50.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:51.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:51.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:51.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:51.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:52.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:52.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:52.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:52.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:53.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:53.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:54.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:54.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:54.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:54.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:55.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:54.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:55.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:55.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:55.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:55.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:56.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:56.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:57.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:57.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:57.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:57.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:58.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:58.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:58.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:58.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:58.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:43:58.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:43:59.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:43:59.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:00.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:00.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:00.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:00.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:01.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:01.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:01.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:01.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:01.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:01.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:02.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:02.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:02.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:02.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:03.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:03.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:03.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:03.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:04.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:04.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:04.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:04.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:05.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:05.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:05.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:05.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:06.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:06.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:06.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:06.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:07.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:07.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:07.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:07.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:08.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:08.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:09.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:09.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:09.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:09.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:10.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:10.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:10.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:10.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:11.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:11.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:11.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:11.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:12.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:12.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:12.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:12.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:13.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:13.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:13.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:13.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:14.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:14.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:14.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:14.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:15.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:15.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:15.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:15.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:16.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:16.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:16.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:16.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:17.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:17.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:17.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:17.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:18.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:18.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:18.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:18.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:19.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:19.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:19.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:19.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:20.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:20.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:20.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:20.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:21.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:21.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:21.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:21.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:22.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:22.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:22.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:22.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:23.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:23.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:23.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:23.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:24.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:24.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:24.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:24.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:25.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:25.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:25.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:25.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:26.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:26.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:26.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:26.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:27.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:27.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:27.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:27.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:28.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:28.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:28.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:28.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:29.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:29.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:29.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:29.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:30.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:30.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:30.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:30.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:31.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:31.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:31.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:31.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:32.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:32.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:32.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:32.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:33.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:33.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:33.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:33.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:34.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:34.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:34.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:34.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:35.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:35.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:35.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:35.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:36.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:36.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:36.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:36.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:37.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:37.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:37.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:37.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:38.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:38.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:38.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:38.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:39.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:39.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:39.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:39.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:40.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:40.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:40.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:40.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:41.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:41.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:41.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:41.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:42.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:42.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:42.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:42.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:43.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:43.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:43.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:43.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:44.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:44.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:44.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:44.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:45.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:45.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:45.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:45.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:46.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:46.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:46.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:46.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:47.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:47.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:47.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:47.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:48.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:48.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:48.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:48.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:49.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:48.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:49.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:49.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:49.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:49.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:50.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:50.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:51.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:51.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:51.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:51.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:52.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:52.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:52.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:52.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:53.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:53.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:53.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:53.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:54.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:54.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:54.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:54.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:55.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:55.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:55.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:55.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:56.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:56.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:56.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:56.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:57.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:57.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:57.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:57.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:58.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:58.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:58.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:58.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:59.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:44:59.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:44:59.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:44:59.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:00.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:00.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:00.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:00.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:01.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:01.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:01.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:01.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:02.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:02.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:02.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:02.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:03.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:03.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:03.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:03.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:04.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:04.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:04.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:04.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:05.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:05.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:05.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:05.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:06.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:06.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:06.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:06.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:07.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:07.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:07.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:07.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:08.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:08.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:08.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:08.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:09.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:09.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:09.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:09.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:10.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:10.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:10.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:10.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:11.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:11.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:11.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:11.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:12.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:12.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:12.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:12.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:13.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:13.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:13.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:13.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:14.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:14.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:14.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:14.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:15.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:15.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:15.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:15.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:16.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:16.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:16.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:16.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:17.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:17.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:17.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:17.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:18.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:18.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:18.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:18.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:19.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:19.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:19.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:19.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:20.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:20.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:20.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:20.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:21.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:21.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:21.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:21.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:22.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:22.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:22.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:22.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:23.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:23.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:23.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:23.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:24.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:24.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:24.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:24.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:25.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:25.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:25.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:25.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:26.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:26.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:26.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:26.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:27.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:27.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:27.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:27.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:28.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:28.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:28.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:28.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:29.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:29.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:29.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:29.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:30.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:30.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:30.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:30.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:31.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:31.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:31.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:31.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:32.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:32.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:32.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:32.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:33.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:33.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:33.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:33.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:34.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:34.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:34.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:34.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:35.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:35.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:35.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:35.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:36.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:36.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:36.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:36.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:37.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:37.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:37.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:37.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:38.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:38.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:38.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:38.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:39.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:39.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:39.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:39.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:40.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:40.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:40.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:40.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:41.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:41.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:41.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:41.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:42.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:42.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:42.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:42.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:43.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:43.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:43.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:43.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:44.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:44.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:44.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:44.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:45.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:45.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:45.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:45.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:46.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:46.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:46.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:46.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:47.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:47.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:47.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:47.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:48.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:48.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:48.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:48.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:49.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:49.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:49.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:49.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:50.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:50.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:50.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:50.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:51.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:51.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:51.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:51.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:51.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:51.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:52.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:52.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:52.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:52.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:53.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:53.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:53.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:53.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:54.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:54.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:54.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:54.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:55.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:55.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:56.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:56.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:56.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:56.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:56.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:56.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:57.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:57.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:57.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:57.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:58.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:58.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:58.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:58.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:59.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:45:59.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:45:59.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:45:59.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:00.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:00.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:00.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:00.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:01.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:01.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:01.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:01.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:02.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:02.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:02.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:02.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:03.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:03.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:03.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:03.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:04.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:04.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:04.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:04.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:05.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:05.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:05.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:05.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:06.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:06.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:06.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:06.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:07.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:07.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:07.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:07.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:08.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:08.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:08.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:08.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:09.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:09.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:09.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:09.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:10.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:10.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:10.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:10.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:11.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:11.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:11.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:11.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:12.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:12.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:12.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:12.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:13.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:13.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:13.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:13.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:14.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:14.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:14.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:14.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:15.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:15.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:15.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:15.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:16.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:16.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:16.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:16.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:17.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:17.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:17.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:17.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:18.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:18.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:18.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:18.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:19.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:19.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:19.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:19.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:20.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:20.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:20.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:20.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:21.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:21.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:21.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:21.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:22.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:22.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:22.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:22.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:23.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:23.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:23.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:23.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:24.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:24.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:24.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:24.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:25.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:25.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:25.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:25.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:26.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:26.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:26.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:27.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:27.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:27.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:27.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:28.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:28.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:28.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:28.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:29.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:29.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:29.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:29.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:30.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:30.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:30.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:30.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:31.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:30.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:31.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:31.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:32.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:32.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:32.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:32.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:32.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:32.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:33.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:33.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:34.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:34.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:34.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:34.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:35.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:35.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:35.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:35.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:35.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:35.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:36.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:36.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:36.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:36.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:37.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:37.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:37.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:37.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:38.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:38.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:38.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:38.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:39.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:39.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:40.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:40.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:40.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:40.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:41.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:41.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:41.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:41.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:42.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:42.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:42.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:42.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:42.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:42.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:43.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:43.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:44.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:44.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:44.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:44.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:44.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:44.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:45.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:45.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:45.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:45.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:46.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:46.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:46.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:46.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:47.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:47.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:48.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:48.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:48.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:48.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:49.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:49.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:49.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:49.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:49.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:49.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:50.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:50.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:50.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:50.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:51.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:51.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:51.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:51.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:52.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:52.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:52.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:52.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:53.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:53.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:53.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:53.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:54.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:54.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:54.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:54.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:55.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:55.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:56.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:56.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:56.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:56.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:57.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:57.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:58.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:58.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:58.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:58.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:59.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:46:59.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:59.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:59.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:46:59.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:46:59.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:00.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:00.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:00.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:00.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:01.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:01.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:02.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:02.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:02.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:02.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:03.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:02.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:03.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:03.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:03.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:03.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:04.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:04.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:05.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:05.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:05.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:05.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:05.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:05.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:06.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:06.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:07.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:06.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:07.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:07.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:07.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:07.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:08.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:08.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:08.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:08.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:09.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:09.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:09.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:09.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:10.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:10.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:10.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:10.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:11.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:11.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:11.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:11.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:12.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:12.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:12.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:12.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:13.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:13.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:13.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:13.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:14.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:14.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:14.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:14.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:15.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:15.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:15.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:15.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:16.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:16.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:16.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:16.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:17.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:17.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:17.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:17.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:18.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:18.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:18.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:18.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:19.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:19.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:19.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:19.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:20.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:20.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:20.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:20.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:21.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:21.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:21.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:21.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:22.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:22.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:22.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:22.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:23.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:23.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:23.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:23.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:24.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:24.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:24.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:24.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:25.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:25.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:25.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:25.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:26.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:26.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:26.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:26.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:27.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:27.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:27.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:27.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:28.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:28.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:28.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:28.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:29.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:29.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:29.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:29.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:30.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:30.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:30.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:30.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:31.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:31.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:31.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:31.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:32.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:32.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:32.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:32.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:33.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:33.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:33.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:33.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:34.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:34.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:34.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:34.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:35.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:35.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:35.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:35.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:36.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:36.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:36.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:36.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:37.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:37.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:37.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:37.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:38.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:38.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:38.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:38.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:39.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:39.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:39.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:39.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:40.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:40.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:40.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:40.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:41.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:41.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:41.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:41.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:42.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:42.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:42.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:42.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:43.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:43.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:43.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:43.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:44.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:44.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:44.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:44.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:45.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:45.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:45.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:45.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:46.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:46.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:46.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:46.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:47.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:47.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:47.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:47.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:48.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:48.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:48.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:48.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:49.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:49.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:49.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:49.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:50.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:50.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:50.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:50.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:51.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:51.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:51.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:51.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:52.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:52.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:52.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:52.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:53.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:53.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:53.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:53.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:54.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:54.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:54.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:54.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:55.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:55.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:55.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:55.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:56.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:56.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:56.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:56.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:57.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:57.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:58.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:58.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:58.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:58.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:59.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:58.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:59.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:47:59.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:47:59.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:47:59.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:00.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:00.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:00.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:00.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:01.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:01.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:01.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:01.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:02.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:02.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:02.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:02.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:03.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:03.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:03.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:03.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:04.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:04.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:05.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:05.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:05.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:05.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:05.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:05.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:06.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:06.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:07.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:07.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:07.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:07.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:08.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:08.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:08.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:08.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:08.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:08.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:09.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:09.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:09.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:09.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:10.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:10.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:10.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:10.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:11.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:11.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:11.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:11.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:12.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:12.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:12.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:12.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:13.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:13.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:13.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:13.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:14.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:14.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:14.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:14.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:15.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:15.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:15.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:15.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:16.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:16.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:16.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:16.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:17.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:17.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:17.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:17.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:18.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:18.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:18.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:18.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:19.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:19.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:19.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:19.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:20.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:20.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:20.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:20.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:21.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:21.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:21.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:21.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:22.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:22.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:22.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:22.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:23.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:23.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:24.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:24.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:24.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:24.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:24.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:24.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:25.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:25.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:25.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:25.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:26.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:26.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:26.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:26.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:27.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:27.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:27.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:27.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:28.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:28.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:28.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:28.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:29.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:29.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:29.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:29.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:30.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:30.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:30.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:30.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:31.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:31.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:31.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:31.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:32.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:32.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:32.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:32.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:33.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:33.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:33.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:33.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:34.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:34.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:34.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:34.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:35.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:35.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:35.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:35.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:36.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:36.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:36.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:36.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:37.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:37.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:37.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:37.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:38.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:38.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:38.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:38.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:39.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:39.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:39.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:39.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:40.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:40.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:40.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:40.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:41.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:41.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:41.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:41.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:42.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:42.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:42.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:42.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:43.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:43.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:43.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:43.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:44.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:44.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:44.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:44.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:45.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:45.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:45.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:45.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:46.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:46.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:46.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:46.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:47.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:47.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:47.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:47.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:48.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:48.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:48.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:48.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:49.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:49.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:49.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:49.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:50.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:50.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:50.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:50.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:51.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:51.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:51.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:51.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:52.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:52.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:52.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:52.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:53.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:53.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:53.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:53.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:54.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:54.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:54.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:54.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:55.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:55.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:56.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:55.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:56.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:56.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:57.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:57.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:57.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:57.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:58.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:58.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:58.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:58.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:59.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:48:59.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:48:59.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:48:59.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:00.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:00.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:00.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:00.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:01.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:01.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:01.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:01.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:02.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:02.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:02.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:02.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:03.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:03.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:03.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:03.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:04.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:04.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:04.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:04.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:05.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:05.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:05.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:05.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:06.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:06.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:06.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:06.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:07.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:07.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:07.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:07.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:08.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:08.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:08.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:08.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:09.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:09.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:09.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:09.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:10.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:10.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:10.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:10.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:11.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:11.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:11.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:11.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:12.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:12.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:12.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:12.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:13.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:13.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:13.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:13.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:14.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:14.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:14.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:14.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:15.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:15.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:15.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:15.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:16.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:16.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:16.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:16.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:17.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:17.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:17.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:17.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:18.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:18.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:18.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:18.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:19.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:19.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:19.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:19.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:20.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:20.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:20.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:20.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:21.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:21.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:21.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:21.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:22.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:22.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:22.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:22.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:23.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:23.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:23.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:23.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:24.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:24.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:24.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:24.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:25.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:25.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:25.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:25.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:26.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:26.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:26.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:26.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:27.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:27.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:27.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:27.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:28.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:28.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:28.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:28.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:29.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:29.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:29.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:29.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:30.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:30.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:30.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:30.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:31.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:31.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:31.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:31.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:32.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:32.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:32.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:32.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:33.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:33.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:33.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:34.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:34.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:34.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:34.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:35.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:35.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:35.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:35.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:36.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:36.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:36.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:36.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:37.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:37.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:37.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:37.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:38.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:38.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:38.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:38.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:39.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:39.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:39.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:39.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:40.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:40.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:40.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:40.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:41.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:41.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:41.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:41.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:42.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:42.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:42.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:42.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:43.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:43.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:43.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:43.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:44.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:44.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:44.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:44.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:45.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:45.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:45.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:45.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:46.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:46.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:46.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:46.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:47.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:47.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:47.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:47.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:48.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:48.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:48.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:48.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:49.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:49.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:49.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:49.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:50.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:50.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:50.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:50.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:51.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:51.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:51.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:51.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:52.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:52.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:52.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:52.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:53.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:53.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:53.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:53.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:54.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:54.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:54.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:54.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:55.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:55.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:55.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:55.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:56.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:56.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:56.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:56.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:57.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:57.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:57.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:57.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:58.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:58.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:58.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:58.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:59.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:49:59.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:49:59.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:49:59.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:00.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:00.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:00.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:00.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:01.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:01.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:01.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:01.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:02.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:02.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:02.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:02.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:03.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:03.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:03.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:03.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:04.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:04.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:04.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:04.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:05.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:05.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:05.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:05.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:06.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:06.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:06.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:06.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:07.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:07.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:07.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:07.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:08.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:08.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:08.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:08.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:09.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:09.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:09.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:09.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:10.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:10.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:10.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:10.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:11.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:11.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:11.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:11.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:12.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:12.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:12.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:12.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:13.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:13.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:13.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:13.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:14.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:14.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:14.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:14.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:15.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:15.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:15.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:15.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:16.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:16.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:16.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:16.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:17.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:17.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:17.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:17.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:18.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:18.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:18.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:18.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:19.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:19.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:19.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:19.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:20.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:20.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:20.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:20.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:21.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:21.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:21.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:21.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:22.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:22.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:22.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:22.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:23.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:23.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:23.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:23.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:24.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:24.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:24.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:24.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:25.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:25.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:25.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:25.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:26.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:26.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:26.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:26.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:27.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:27.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:27.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:27.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:28.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:28.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:28.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:28.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:29.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:29.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:29.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:29.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:30.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:30.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:30.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:30.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:31.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:31.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:31.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:31.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:32.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:32.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:32.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:32.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:33.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:33.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:33.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:33.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:34.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:34.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:34.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:34.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:35.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:35.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:35.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:35.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:36.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:36.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:36.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:36.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:37.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:37.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:37.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:37.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:38.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:38.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:38.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:38.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:39.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:39.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:39.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:39.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:40.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:40.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:40.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:40.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:41.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:41.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:41.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:41.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:42.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:42.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:42.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:42.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:43.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:43.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:43.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:43.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:44.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:44.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:44.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:44.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:45.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:45.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:45.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:45.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:46.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:46.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:46.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:46.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:47.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:47.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:47.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:47.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:48.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:48.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:48.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:48.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:49.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:49.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:49.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:49.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:50.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:50.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:50.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:50.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:51.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:51.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:51.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:51.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:52.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:52.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:52.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:52.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:53.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:53.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:53.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:53.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:54.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:54.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:54.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:54.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:55.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:55.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:55.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:55.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:56.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:56.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:56.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:56.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:57.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:57.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:57.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:57.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:58.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:58.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:58.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:58.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:59.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:50:59.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:50:59.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:50:59.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:00.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:00.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:00.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:00.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:01.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:01.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:01.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:01.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:02.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:02.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:02.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:02.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:03.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:03.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:03.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:03.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:04.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:04.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:04.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:04.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:05.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:05.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:05.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:05.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:06.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:06.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:06.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:06.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:07.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:07.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:07.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:07.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:08.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:08.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:08.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:08.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:09.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:09.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:09.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:09.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:10.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:10.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:10.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:10.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:11.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:11.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:11.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:11.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:12.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:12.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:12.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:12.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:13.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:13.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:13.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:13.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:14.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:14.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:14.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:14.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:15.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:15.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:15.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:15.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:16.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:16.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:16.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:16.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:17.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:17.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:17.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:17.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:18.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:18.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:18.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:18.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:19.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:19.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:19.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:19.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:20.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:20.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:20.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:20.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:21.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:21.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:21.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:21.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:22.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:22.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:22.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:22.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:23.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:23.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:23.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:23.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:24.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:24.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:24.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:24.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:25.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:25.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:25.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:25.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:26.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:26.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:26.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:26.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:27.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:27.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:27.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:27.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:28.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:28.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:28.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:28.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:29.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:29.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:29.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:29.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:30.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:30.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:30.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:30.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:31.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:31.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:31.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:31.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:32.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:32.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:32.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:32.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:33.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:33.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:33.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:33.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:34.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:34.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:34.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:34.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:35.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:35.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:35.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:35.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:36.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:36.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:36.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:36.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:37.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:37.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:37.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:37.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:38.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:38.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:38.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:38.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:39.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:39.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:39.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:39.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:40.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:40.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:40.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:40.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:41.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:41.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:41.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:41.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:42.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:42.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:42.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:42.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:43.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:43.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:43.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:43.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:44.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:44.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:44.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:44.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:45.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:45.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:45.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:45.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:46.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:46.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:46.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:46.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:47.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:47.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:47.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:47.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:48.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:48.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:48.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:48.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:49.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:49.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:49.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:49.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:50.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:50.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:50.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:50.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:51.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:51.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:51.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:51.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:52.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:52.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:52.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:52.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:53.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:53.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:53.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:53.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:54.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:54.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:54.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:54.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:55.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:55.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:55.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:55.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:56.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:56.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:56.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:56.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:57.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:57.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:57.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:57.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:58.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:58.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:58.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:58.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:59.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:51:59.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:51:59.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:51:59.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:00.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:00.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:00.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:00.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:01.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:01.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:01.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:01.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:02.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:02.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:02.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:02.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:03.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:03.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:03.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:03.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:04.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:04.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:04.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:04.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:05.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:05.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:05.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:05.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:06.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:06.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:06.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:06.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:07.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:07.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:07.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:07.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:08.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:08.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:08.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:08.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:09.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:09.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:09.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:09.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:10.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:10.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:10.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:10.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:11.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:11.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:11.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:11.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:12.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:12.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:12.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:12.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:13.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:13.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:13.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:13.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:14.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:14.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:14.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:14.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:15.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:15.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:15.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:15.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:16.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:16.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:16.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:16.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:17.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:17.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:17.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:17.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:18.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:18.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:18.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:18.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:19.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:19.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:19.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:19.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:20.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:20.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:20.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:20.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:21.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:21.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:21.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:21.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:22.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:22.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:22.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:22.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:23.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:23.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:23.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:23.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:24.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:24.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:24.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:24.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:25.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:25.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:25.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:25.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:26.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:26.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:26.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:26.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:27.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:27.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:27.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:27.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:28.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:28.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:28.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:28.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:29.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:29.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:29.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:29.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:30.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:30.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:30.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:30.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:31.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:31.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:31.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:31.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:32.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:32.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:32.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:32.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:33.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:33.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:33.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:33.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:34.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:34.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:34.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:34.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:35.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:35.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:35.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:35.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:36.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:36.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:36.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:36.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:37.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:37.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:37.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:37.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:38.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:38.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:38.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:38.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:39.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:39.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:39.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:39.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:40.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:40.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:40.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:40.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:41.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:41.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:41.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:41.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:42.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:42.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:42.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:42.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:43.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:43.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:43.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:43.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:44.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:44.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:44.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:44.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:45.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:45.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:45.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:45.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:46.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:46.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:46.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:46.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:47.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:47.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:47.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:47.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:48.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:48.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:48.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:48.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:49.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:49.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:49.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:49.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:50.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:50.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:50.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:50.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:51.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:51.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:51.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:51.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:52.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:52.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:53.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:52.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:53.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:53.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:53.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:53.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:54.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:54.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:54.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:54.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:55.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:55.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:55.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:55.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:56.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:56.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:56.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:56.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:57.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:57.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:57.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:57.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:58.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:58.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:58.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:58.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:59.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:52:59.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:52:59.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:52:59.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:00.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:00.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:00.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:00.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:01.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:01.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:01.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:01.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:02.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:02.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:02.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:02.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:03.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:03.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:03.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:03.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:04.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:04.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:04.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:04.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:05.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:05.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:05.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:05.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:06.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:06.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:06.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:06.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:07.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:07.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:07.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:07.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:08.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:08.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:08.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:08.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:09.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:09.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:09.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:09.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:10.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:10.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:10.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:10.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:11.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:11.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:11.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:11.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:12.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:12.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:12.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:12.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:13.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:13.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:13.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:13.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:14.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:14.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:14.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:14.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:15.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:15.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:15.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:15.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:16.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:16.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:16.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:16.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:17.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:17.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:17.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:17.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:18.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:18.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:18.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:18.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:19.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:19.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:19.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:19.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:20.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:20.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:20.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:20.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:21.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:21.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:21.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:21.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:22.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:22.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:22.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:22.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:23.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:23.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:23.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:23.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:24.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:24.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:24.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:24.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:25.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:25.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:25.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:25.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:26.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:26.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:26.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:26.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:27.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:27.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:27.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:27.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:28.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:28.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:28.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:28.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:29.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:29.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:29.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:29.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:30.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:30.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:30.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:30.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:31.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:31.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:31.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:31.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:32.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:32.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:32.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:32.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:33.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:33.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:33.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:33.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:34.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:34.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:34.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:34.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:35.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:35.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:35.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:35.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:36.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:36.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:36.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:36.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:37.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:37.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:37.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:37.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:38.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:38.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:38.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:38.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:39.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:39.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:39.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:39.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:40.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:40.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:40.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:40.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:41.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:41.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:41.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:41.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:42.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:42.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:42.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:42.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:43.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:43.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:43.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:43.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:44.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:44.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:44.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:44.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:45.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:45.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:45.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:45.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:46.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:46.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:46.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:46.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:47.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:47.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:47.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:47.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:48.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:48.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:48.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:48.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:49.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:49.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:49.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:49.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:50.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:50.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:50.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:50.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:51.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:51.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:51.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:51.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:52.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:52.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:52.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:52.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:53.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:53.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:54.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:53.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:54.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:54.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:55.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:55.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:55.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:55.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:56.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:56.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:56.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:56.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:57.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:57.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:57.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:57.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:57.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:57.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:58.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:58.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:59.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:59.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:53:59.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:53:59.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:00.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:53:59.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:00.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:00.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:00.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:00.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:01.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:01.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:02.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:02.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:02.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:02.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:02.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:02.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:03.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:03.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:03.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:03.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:04.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:04.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:04.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:04.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:05.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:05.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:05.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:05.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:06.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:06.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:06.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:06.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:07.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:07.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:07.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:07.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:08.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:08.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:08.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:08.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:09.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:09.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:09.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:09.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:10.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:10.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:10.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:10.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:11.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:11.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:11.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:11.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:12.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:12.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:12.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:12.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:13.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:13.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:13.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:13.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:14.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:14.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:14.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:14.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:15.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:15.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:15.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:15.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:16.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:16.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:16.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:16.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:17.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:17.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:17.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:17.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:18.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:18.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:18.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:18.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:19.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:19.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:19.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:19.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:20.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:20.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:21.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:21.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:21.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:21.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:22.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:22.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:22.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:22.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:23.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:23.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:23.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:23.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:23.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:23.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:24.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:24.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:25.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:25.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:25.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:25.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:26.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:26.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:26.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:26.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:27.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:27.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:27.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:27.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:28.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:28.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:28.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:28.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:29.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:29.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:29.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:29.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:30.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:30.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:30.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:30.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:31.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:31.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:31.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:31.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:32.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:32.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:32.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:32.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:33.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:33.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:33.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:33.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:34.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:34.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:34.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:34.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:35.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:35.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:35.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:35.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:36.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:36.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:36.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:36.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:37.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:37.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:37.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:37.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:38.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:38.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:38.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:38.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:39.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:39.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:39.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:40.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:40.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:40.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:40.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:41.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:41.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:41.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:41.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:42.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:42.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:42.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:42.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:43.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:43.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:43.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:43.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:44.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:44.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:44.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:44.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:44.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:44.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:45.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:45.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:45.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:45.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:46.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:46.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:47.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:47.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:47.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:47.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:48.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:48.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:48.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:48.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:49.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:49.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:49.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:49.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:50.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:50.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:50.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:50.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:50.925 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-19T23:54:50.921+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d63e73c0 msgr2=0x7f5fa4127b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-19T23:54:51.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:51.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:51.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:51.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:52.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:52.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:52.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:52.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:53.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:53.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:53.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:53.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:54.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:54.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:54.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:54.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:55.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:55.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:55.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:55.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:56.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:56.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:56.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:56.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:57.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:57.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:57.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:57.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:58.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:58.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:58.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:58.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:59.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:54:59.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:54:59.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:54:59.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:00.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:00.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:00.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:00.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:01.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:01.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:01.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:01.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:02.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:02.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:02.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:02.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:03.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:03.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:03.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:03.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:04.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:04.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:04.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:04.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:05.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:05.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:05.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:05.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:06.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:06.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:06.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:06.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:07.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:07.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:07.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:07.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:08.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:08.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:08.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:08.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:09.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:09.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:09.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:09.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:10.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:10.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:10.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:10.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:11.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:11.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:11.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:11.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:12.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:12.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:12.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:12.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:13.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:13.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:13.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:13.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:14.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:14.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:14.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:14.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:15.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:15.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:15.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:15.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:16.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:16.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:16.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:16.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:17.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:17.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:17.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:17.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:18.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:18.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:18.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:18.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:19.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:19.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:19.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:19.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:20.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:20.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:20.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:20.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:21.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:21.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:21.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:21.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:22.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:22.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:22.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:22.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:23.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:23.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:23.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:23.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:24.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:24.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:24.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:24.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:25.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:25.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:25.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:25.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:26.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:26.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:26.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:26.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:27.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:27.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:27.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:27.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:28.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:28.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:28.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:28.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:29.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:29.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:29.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:29.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:30.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:30.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:30.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:30.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:31.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:31.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:31.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:31.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:32.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:32.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:32.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:32.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:33.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:33.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:33.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:33.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:34.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:34.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:34.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:34.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:35.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:35.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:35.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:35.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:36.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:36.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:36.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:36.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:37.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:37.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:37.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:37.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:38.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:38.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:38.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:38.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:39.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:39.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:39.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:39.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:40.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:40.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:41.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:41.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:41.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:41.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:42.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:42.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:42.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:42.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:43.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:43.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:43.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:43.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:44.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:44.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:44.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:44.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:45.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:45.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:45.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:45.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:46.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:46.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:46.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:46.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:47.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:47.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:47.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:47.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:48.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:48.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:48.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:48.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:49.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:49.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:49.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:49.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:50.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:50.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:50.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:50.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:51.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:51.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:51.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:51.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:52.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:52.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:52.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:52.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:53.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:53.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:53.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:53.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:54.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:54.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:54.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:54.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:55.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:55.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:55.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:55.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:56.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:56.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:56.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:56.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:57.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:57.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:57.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:57.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:58.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:58.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:58.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:58.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:59.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:55:59.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:55:59.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:55:59.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:00.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:00.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:00.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:00.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:01.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:01.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:01.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:01.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:02.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:02.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:02.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:02.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:03.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:03.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:03.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:03.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:04.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:04.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:04.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:04.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:05.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:05.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:05.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:05.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:06.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:06.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:06.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:06.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:07.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:07.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:07.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:07.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:08.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:08.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:08.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:08.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:09.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:09.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:09.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:09.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:10.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:10.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:10.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:10.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:11.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:11.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:11.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:11.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:12.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:12.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:12.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:12.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:13.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:13.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:13.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:13.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:14.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:14.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:14.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:14.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:15.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:15.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:15.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:15.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:16.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:16.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:16.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:16.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:17.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:17.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:17.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:17.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:18.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:18.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:18.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:18.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:19.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:19.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:19.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:19.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:20.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:20.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:20.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:20.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:21.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:21.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:21.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:21.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:22.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:22.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:22.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:22.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:23.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:23.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:23.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:23.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:24.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:24.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:24.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:24.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:25.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:25.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:25.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:25.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:26.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:26.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:26.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:26.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:27.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:27.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:27.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:27.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:28.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:28.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:28.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:28.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:29.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:29.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:29.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:29.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:30.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:30.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:30.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:30.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:31.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:31.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:31.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:31.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:32.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:32.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:32.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:32.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:33.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:33.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:33.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:33.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:34.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:34.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:34.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:34.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:35.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:35.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:35.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:35.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:36.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:36.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:36.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:36.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:37.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:37.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:37.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:37.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:38.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:38.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:38.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:38.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:39.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:39.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:39.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:39.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:40.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:40.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:40.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:40.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:41.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:41.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:41.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:41.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:42.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:42.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:42.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:42.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:43.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:43.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:43.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:43.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:44.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:44.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:44.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:44.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:45.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:45.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:45.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:45.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:46.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:46.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:46.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:46.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:47.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:47.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:47.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:47.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:48.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:48.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:48.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:48.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:49.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:49.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:49.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:49.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:50.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:50.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:50.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:50.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:51.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:51.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:51.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:51.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:52.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:52.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:52.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:52.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:53.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:53.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:53.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:53.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:54.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:54.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:54.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:54.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:55.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:55.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:55.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:55.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:56.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:56.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:56.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:56.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:57.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:57.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:57.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:57.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:58.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:58.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:58.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:58.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:59.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:56:59.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:56:59.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:56:59.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:00.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:00.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:00.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:00.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:01.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:01.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:01.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:01.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:02.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:02.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:02.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:02.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:03.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:03.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:03.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:03.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:04.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:04.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:04.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:04.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:05.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:05.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:05.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:05.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:06.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:06.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:06.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:06.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:07.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:07.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:07.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:07.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:08.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:08.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:08.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:08.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:09.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:09.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:09.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:09.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:10.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:10.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:10.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:10.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:11.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:11.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:11.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:11.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:12.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:12.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:12.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:12.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:13.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:13.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:13.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:13.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:14.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:14.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:14.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:14.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:15.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:15.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:15.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:15.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:16.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:16.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:16.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:16.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:17.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:17.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:17.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:17.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:18.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:18.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:18.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:18.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:19.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:19.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:19.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:19.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:20.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:20.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:20.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:20.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:21.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:21.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:21.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:21.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:22.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:22.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:22.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:22.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:23.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:23.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:23.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:23.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:24.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:24.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:24.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:24.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:25.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:25.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:25.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:25.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:26.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:26.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:26.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:26.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:27.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:27.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:27.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:27.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:28.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:28.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:28.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:28.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:29.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:29.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:29.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:29.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:30.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:30.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:30.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:30.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:31.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:31.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:31.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:31.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:32.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:32.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:32.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:32.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:33.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:33.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:33.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:33.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:34.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:34.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:34.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:34.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:35.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:35.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:35.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:35.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:36.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:36.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:36.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:36.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:37.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:37.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:37.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:37.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:38.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:38.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:38.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:38.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:39.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:39.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:39.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:39.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:40.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:40.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:40.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:40.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:41.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:41.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:41.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:41.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:42.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:42.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:42.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:42.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:43.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:43.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:43.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:43.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:44.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:44.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:44.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:44.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:45.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:45.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:45.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:45.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:46.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:46.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:46.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:46.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:47.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:47.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:47.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:47.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:48.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:48.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:48.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:48.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:49.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:49.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:49.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:49.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:50.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:50.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:50.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:50.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:51.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:51.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:51.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:51.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:52.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:52.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:52.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:52.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:53.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:53.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:53.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:53.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:54.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:54.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:54.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:54.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:55.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:55.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:55.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:55.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:56.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:56.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:56.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:56.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:57.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:57.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:57.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:57.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:58.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:58.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:58.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:58.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:59.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:57:59.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:57:59.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:57:59.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:00.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:00.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:00.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:00.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:01.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:01.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:01.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:01.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:02.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:02.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:02.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:02.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:03.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:03.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:03.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:03.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:04.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:04.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:04.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:04.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:05.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:05.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:05.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:05.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:06.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:06.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:06.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:06.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:07.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:07.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:07.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:07.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:08.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:08.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:08.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:08.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:09.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:09.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:09.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:09.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:10.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:10.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:10.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:10.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:11.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:11.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:11.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:11.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:12.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:12.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:12.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:12.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:13.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:13.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:13.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:13.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:14.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:14.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:14.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:14.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:15.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:15.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:15.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:15.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:16.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:16.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:16.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:16.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:17.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:17.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:17.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:17.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:18.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:18.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:18.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:18.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:19.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:19.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:19.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:19.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:20.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:20.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:20.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:20.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:21.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:21.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:21.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:21.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:22.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:22.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:22.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:22.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:23.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:23.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:23.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:23.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:24.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:24.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:24.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:24.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:25.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:25.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:25.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:25.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:26.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:26.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:26.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:26.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:27.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:27.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:27.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:27.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:28.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:28.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:28.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:28.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:29.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:29.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:29.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:29.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:30.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:30.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:30.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:30.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:31.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:31.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:31.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:31.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:32.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:32.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:32.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:32.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:33.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:33.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:33.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:33.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:34.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:34.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:34.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:34.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:35.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:35.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:35.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:35.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:36.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:36.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:36.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:36.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:37.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:37.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:37.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:37.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:38.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:38.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:38.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:38.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:39.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:39.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:39.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:39.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:40.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:40.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:40.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:40.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:41.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:41.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:41.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:41.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:42.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:42.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:42.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:42.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:43.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:43.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:43.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:43.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:44.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:44.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:44.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:44.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:45.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:45.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:45.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:45.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:46.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:46.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:46.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:46.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:47.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:47.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:47.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:47.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:48.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:48.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:48.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:48.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:49.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:49.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:49.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:49.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:50.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:50.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:50.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:50.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:51.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:51.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:51.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:51.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:52.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:52.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:52.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:52.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:53.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:53.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:53.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:53.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:54.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:54.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:54.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:54.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:55.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:55.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:55.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:55.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:56.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:56.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:56.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:56.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:57.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:57.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:57.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:57.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:58.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:58.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:58.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:58.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:59.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:58:59.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:58:59.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:58:59.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:00.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:00.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:00.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:00.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:01.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:01.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:01.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:01.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:02.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:02.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:02.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:02.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:03.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:03.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:03.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:03.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:04.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:04.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:04.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:04.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:05.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:05.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:05.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:05.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:06.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:06.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:06.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:06.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:07.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:07.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:07.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:07.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:08.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:08.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:08.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:08.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:09.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:09.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:09.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:09.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:10.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:10.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:10.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:10.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:11.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:11.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:11.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:11.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:12.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:12.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:12.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:12.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:13.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:13.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:13.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:13.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:14.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:14.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:14.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:14.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:15.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:15.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:15.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:15.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:16.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:16.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:16.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:16.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:17.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:17.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:17.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:17.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:18.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:18.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:18.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:18.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:19.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:19.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:19.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:19.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:20.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:20.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:20.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:20.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:21.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:21.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:21.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:21.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:22.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:22.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:22.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:22.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:23.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:23.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:23.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:23.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:24.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:24.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:24.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:24.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:25.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:25.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:25.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:25.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:26.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:26.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:26.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:26.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:27.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:27.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:27.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:27.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:28.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:28.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:28.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:28.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:29.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:29.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:29.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:29.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:30.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:30.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:30.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:30.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:31.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:31.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:31.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:31.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:32.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:32.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:32.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:32.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:33.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:33.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:33.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:33.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:34.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:34.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:34.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:34.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:35.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:35.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:35.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:35.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:36.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:36.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:36.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:36.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:37.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:37.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:37.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:37.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:38.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:38.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:38.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:38.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:39.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:39.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:39.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:39.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:40.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:40.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:40.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:40.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:41.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:41.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:41.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:41.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:42.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:42.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:42.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:42.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:43.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:43.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:43.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:43.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:44.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:44.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:44.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:44.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:45.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:45.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:45.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:45.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:46.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:46.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:46.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:46.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:47.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:47.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:47.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:47.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:48.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:48.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:48.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:48.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:49.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:49.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:49.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:49.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:50.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:50.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:50.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:50.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:51.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:51.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:51.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:51.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:52.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:52.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:52.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:52.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:53.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:53.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:53.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:53.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:54.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:54.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:54.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:54.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:55.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:55.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:55.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:55.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:56.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:56.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:56.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:56.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:57.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:57.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:57.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:57.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:58.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:58.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:58.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:58.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:59.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-19T23:59:59.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-19T23:59:59.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-19T23:59:59.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:00.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:00.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:00.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:00.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:01.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:01.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:01.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:01.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:02.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:02.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:02.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:02.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:03.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:03.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:03.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:03.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:04.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:04.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:04.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:04.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:05.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:05.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:05.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:05.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:06.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:06.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:06.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:06.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:07.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:07.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:07.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:07.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:08.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:08.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:08.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:08.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:09.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:09.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:09.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:09.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:10.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:10.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:10.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:10.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:11.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:11.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:11.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:11.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:12.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:12.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:12.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:12.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:13.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:13.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:13.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:13.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:14.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:14.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:14.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:14.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:15.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:15.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:16.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:16.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:16.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:16.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:17.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:17.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:17.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:17.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:17.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:17.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:18.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:18.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:18.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:18.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:19.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:19.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:20.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:20.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:20.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:20.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:20.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:20.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:21.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:21.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:22.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:22.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:22.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:22.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:22.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:22.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:23.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:23.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:24.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:24.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:24.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:24.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:25.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:25.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:25.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:25.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:26.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:26.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:26.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:26.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:27.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:27.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:27.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:27.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:28.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:28.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:28.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:28.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:29.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:29.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:29.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:29.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:30.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:30.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:30.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:30.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:31.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:31.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:31.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:31.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:32.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:32.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:32.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:32.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:33.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:33.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:33.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:33.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:34.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:34.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:34.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:34.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:35.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:35.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:35.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:35.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:36.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:36.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:36.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:36.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:37.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:37.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:37.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:37.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:38.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:38.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:38.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:38.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:39.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:39.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:39.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:39.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:40.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:40.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:40.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:40.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:41.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:41.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:41.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:41.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:42.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:42.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:42.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:42.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:43.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:43.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:43.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:43.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:44.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:44.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:44.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:44.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:45.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:45.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:45.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:45.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:46.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:46.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:46.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:46.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:47.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:47.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:47.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:47.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:48.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:48.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:48.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:48.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:49.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:49.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:49.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:49.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:50.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:50.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:50.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:50.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:51.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:51.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:51.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:51.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:52.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:52.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:52.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:52.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:53.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:53.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:53.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:53.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:54.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:54.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:54.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:54.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:55.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:55.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:55.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:55.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:56.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:56.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:56.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:56.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:57.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:57.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:57.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:57.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:58.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:58.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:58.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:58.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:59.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:00:59.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:00:59.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:00:59.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:00.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:00.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:00.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:01.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:01.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:01.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:01.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:02.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:02.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:02.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:02.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:03.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:03.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:03.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:03.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:04.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:04.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:04.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:04.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:05.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:05.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:05.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:05.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:06.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:06.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:06.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:06.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:07.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:07.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:07.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:07.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:08.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:08.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:08.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:08.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:09.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:09.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:09.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:09.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:09.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:09.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:10.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:10.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:11.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:11.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:11.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:11.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:12.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:12.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:12.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:12.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:13.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:13.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:13.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:13.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:14.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:14.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:14.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:14.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:15.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:15.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:15.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:15.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:16.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:16.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:16.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:16.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:17.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:17.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:17.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:17.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:18.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:18.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:18.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:18.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:19.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:19.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:19.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:19.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:20.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:20.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:20.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:20.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:21.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:21.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:21.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:21.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:22.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:22.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:22.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:22.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:23.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:23.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:23.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:23.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:24.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:24.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:24.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:24.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:25.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:25.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:25.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:25.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:26.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:26.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:26.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:26.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:27.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:27.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:27.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:27.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:28.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:28.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:28.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:28.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:29.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:29.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:29.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:29.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:30.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:30.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:30.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:30.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:31.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:31.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:31.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:31.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:32.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:32.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:32.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:32.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:33.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:33.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:33.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:33.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:34.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:34.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:34.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:34.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:35.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:35.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:35.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:35.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:36.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:36.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:37.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:37.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:37.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:37.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:37.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:37.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:38.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:38.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:38.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:38.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:39.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:39.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:39.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:39.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:40.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:40.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:40.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:40.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:41.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:41.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:41.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:41.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:42.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:42.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:42.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:42.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:43.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:43.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:43.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:43.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:44.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:44.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:44.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:44.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:45.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:45.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:45.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:45.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:46.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:46.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:46.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:46.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:46.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:46.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:47.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:47.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:48.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:48.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:48.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:48.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:49.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:49.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:49.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:49.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:49.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:49.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:50.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:50.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:50.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:50.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:51.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:51.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:51.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:51.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:52.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:52.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:53.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:53.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:53.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:53.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:54.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:53.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:54.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:54.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:55.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:54.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:55.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:55.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:55.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:55.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:56.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:56.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:56.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:56.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:57.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:57.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:57.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:57.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:58.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:58.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:58.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:58.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:59.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:01:59.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:01:59.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:01:59.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:00.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:00.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:00.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:00.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:01.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:01.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:01.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:01.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:02.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:02.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:02.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:02.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:03.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:03.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:03.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:03.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:04.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:04.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:04.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:04.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:05.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:05.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:05.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:05.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:06.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:06.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:06.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:06.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:07.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:07.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:07.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:07.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:08.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:08.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:08.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:08.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:09.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:09.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:09.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:09.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:10.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:10.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:10.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:10.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:11.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:11.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:11.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:11.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:12.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:12.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:12.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:12.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:13.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:13.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:13.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:13.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:14.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:14.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:15.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:15.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:15.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:15.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:16.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:16.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:16.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:16.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:17.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:17.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:17.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:17.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:18.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:18.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:18.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:18.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:19.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:19.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:19.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:19.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:20.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:20.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:20.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:20.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:21.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:21.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:21.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:21.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:22.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:22.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:22.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:22.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:23.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:23.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:23.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:23.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:24.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:24.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:24.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:24.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:24.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:24.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:25.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:25.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:25.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:25.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:26.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:26.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:26.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:26.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:27.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:27.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:27.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:27.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:28.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:28.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:28.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:28.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:29.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:29.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:29.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:29.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:30.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:30.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:30.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:30.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:31.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:31.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:32.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:32.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:32.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:32.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:32.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:32.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:33.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:33.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:33.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:33.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:34.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:34.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:35.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:35.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:35.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:35.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:35.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:35.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:36.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:36.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:37.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:37.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:37.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:37.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:38.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:38.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:38.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:38.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:39.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:39.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:39.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:39.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:40.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:40.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:40.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:40.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:41.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:41.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:41.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:41.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:42.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:42.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:42.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:42.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:43.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:43.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:43.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:43.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:44.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:44.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:44.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:44.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:45.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:45.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:45.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:45.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:46.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:46.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:46.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:46.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:47.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:47.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:47.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:47.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:48.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:48.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:48.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:48.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:49.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:49.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:49.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:49.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:50.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:50.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:50.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:50.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:51.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:51.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:51.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:51.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:52.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:52.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:52.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:52.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:53.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:53.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:53.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:53.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:54.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:54.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:54.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:54.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:55.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:55.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:55.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:55.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:56.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:56.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:56.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:56.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:57.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:57.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:57.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:57.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:58.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:58.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:58.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:58.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:59.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:02:59.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:02:59.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:02:59.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:00.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:00.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:00.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:00.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:01.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:01.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:01.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:01.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:02.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:02.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:02.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:02.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:03.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:03.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:03.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:03.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:04.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:04.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:04.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:04.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:05.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:05.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:05.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:05.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:06.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:06.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:06.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:06.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:07.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:07.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:07.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:07.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:08.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:08.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:08.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:08.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:09.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:09.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:09.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:09.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:10.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:10.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:10.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:10.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:11.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:11.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:11.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:11.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:12.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:12.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:12.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:12.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:13.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:13.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:13.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:13.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:14.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:14.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:14.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:14.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:15.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:15.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:15.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:15.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:16.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:16.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:16.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:16.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:17.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:17.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:17.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:17.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:18.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:18.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:18.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:18.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:19.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:19.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:19.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:19.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:20.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:20.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:20.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:20.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:21.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:21.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:21.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:21.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:22.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:22.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:22.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:22.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:23.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:23.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:23.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:23.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:24.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:24.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:24.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:24.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:25.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:25.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:25.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:25.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:26.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:26.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:26.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:26.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:27.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:27.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:27.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:27.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:28.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:28.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:28.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:28.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:29.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:29.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:29.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:29.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:30.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:30.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:30.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:30.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:31.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:31.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:31.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:31.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:32.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:32.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:32.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:32.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:33.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:33.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:33.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:33.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:34.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:34.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:34.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:34.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:35.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:35.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:35.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:35.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:36.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:36.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:36.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:36.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:37.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:37.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:37.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:37.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:38.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:38.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:38.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:38.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:39.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:39.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:39.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:39.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:40.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:40.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:40.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:40.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:41.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:41.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:41.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:41.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:42.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:42.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:42.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:42.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:43.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:43.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:43.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:43.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:44.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:44.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:44.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:44.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:45.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:45.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:45.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:45.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:46.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:46.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:46.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:47.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:47.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:47.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:47.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:48.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:48.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:48.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:48.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:49.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:49.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:49.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:49.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:50.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:50.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:50.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:50.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:51.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:51.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:52.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:52.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:52.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:52.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:53.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:53.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:53.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:53.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:54.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:54.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:54.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:54.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:55.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:55.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:55.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:55.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:56.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:56.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:56.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:56.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:57.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:57.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:57.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:57.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:58.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:58.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:58.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:58.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:59.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:03:59.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:03:59.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:03:59.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:00.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:00.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:00.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:00.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:01.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:01.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:01.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:01.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:02.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:02.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:02.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:02.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:03.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:03.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:03.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:03.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:04.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:04.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:04.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:04.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:05.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:05.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:05.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:05.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:06.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:06.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:06.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:06.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:07.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:07.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:07.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:07.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:08.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:08.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:08.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:08.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:09.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:09.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:09.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:09.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:10.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:10.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:10.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:10.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:10.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:10.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:11.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:11.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:12.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:12.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:12.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:12.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:12.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:12.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:13.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:13.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:14.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:13.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:14.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:14.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:14.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:14.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:15.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:15.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:16.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:16.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:16.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:16.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:17.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:17.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:17.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:17.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:18.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:17.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:18.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:18.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:18.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:18.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:19.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:19.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:20.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:20.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:20.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:20.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:21.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:21.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:21.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:21.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:22.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:21.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:22.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:22.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:23.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:23.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:23.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:23.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:23.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:23.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:24.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:24.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:25.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:25.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:25.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:25.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:25.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:25.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:26.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:26.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:26.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:26.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:27.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:27.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:27.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:27.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:28.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:28.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:28.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:28.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:29.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:29.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:29.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:29.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:30.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:30.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:30.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:30.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:31.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:31.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:31.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:31.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:32.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:32.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:32.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:32.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:33.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:33.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:33.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:33.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:34.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:34.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:34.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:34.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:35.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:35.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:35.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:35.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:36.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:36.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:36.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:36.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:37.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:37.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:37.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:37.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:38.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:38.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:38.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:38.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:39.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:39.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:39.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:39.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:40.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:40.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:40.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:40.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:41.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:41.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:41.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:41.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:42.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:42.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:42.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:42.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:43.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:43.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:43.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:43.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:44.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:44.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:44.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:44.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:45.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:45.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:45.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:45.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:46.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:46.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:46.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:46.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:47.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:47.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:47.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:48.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:48.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:48.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:48.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:49.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:49.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:50.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:50.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:50.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:50.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:51.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:51.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:51.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:51.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:52.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:52.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:52.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:52.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:53.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:53.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:53.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:53.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:54.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:54.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:54.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:54.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:55.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:55.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:55.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:55.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:56.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:56.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:56.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:56.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:57.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:57.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:57.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:57.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:58.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:58.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:58.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:58.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:59.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:04:59.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:04:59.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:04:59.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:00.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:00.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:00.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:00.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:01.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:01.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:01.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:01.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:02.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:02.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:02.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:02.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:03.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:03.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:03.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:03.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:04.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:04.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:04.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:04.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:05.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:05.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:05.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:05.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:06.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:06.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:06.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:06.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:07.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:07.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:07.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:07.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:08.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:08.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:08.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:08.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:09.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:09.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:09.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:09.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:10.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:10.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:10.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:10.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:11.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:11.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:11.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:11.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:12.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:12.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:12.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:12.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:13.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:13.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:13.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:13.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:14.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:14.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:14.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:14.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:15.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:15.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:15.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:15.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:16.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:16.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:16.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:16.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:17.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:17.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:17.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:17.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:18.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:18.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:18.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:18.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:19.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:19.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:19.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:19.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:20.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:20.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:20.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:20.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:21.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:21.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:21.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:21.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:22.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:22.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:22.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:22.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:23.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:23.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:23.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:23.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:24.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:24.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:24.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:24.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:25.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:25.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:25.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:25.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:26.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:26.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:26.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:26.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:27.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:27.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:27.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:27.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:28.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:28.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:28.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:28.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:29.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:29.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:29.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:29.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:30.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:30.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:30.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:30.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:31.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:31.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:31.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:31.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:32.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:32.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:32.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:32.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:33.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:33.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:33.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:33.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:34.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:34.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:34.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:34.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:35.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:35.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:35.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:35.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:36.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:36.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:36.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:36.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:37.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:37.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:37.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:37.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:38.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:38.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:38.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:38.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:39.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:39.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:39.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:39.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:40.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:40.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:40.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:40.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:41.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:41.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:41.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:41.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:42.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:42.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:42.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:42.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:43.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:43.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:43.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:43.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:44.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:44.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:44.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:44.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:45.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:45.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:45.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:45.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:46.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:46.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:46.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:46.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:47.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:47.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:47.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:47.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:48.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:48.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:48.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:48.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:49.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:49.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:49.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:49.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:50.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:50.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:50.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:50.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:51.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:51.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:51.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:51.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:51.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:51.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:52.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:52.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:53.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:53.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:53.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:53.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:54.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:54.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:54.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:54.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:55.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:55.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:55.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:55.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:56.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:56.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:56.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:56.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:57.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:57.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:57.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:57.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:58.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:58.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:58.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:58.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:59.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:05:59.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:05:59.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:05:59.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:00.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:00.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:00.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:00.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:01.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:01.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:01.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:01.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:02.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:02.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:02.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:02.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:03.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:03.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:03.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:03.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:03.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:03.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:04.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:04.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:04.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:04.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:05.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:05.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:05.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:05.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:06.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:06.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:06.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:06.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:07.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:07.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:07.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:07.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:08.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:08.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:08.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:08.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:09.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:09.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:09.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:09.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:10.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:10.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:10.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:10.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:11.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:11.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:11.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:11.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:12.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:12.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:12.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:12.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:13.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:13.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:13.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:13.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:14.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:14.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:14.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:14.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:15.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:15.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:15.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:15.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:16.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:16.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:16.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:16.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:17.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:17.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:17.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:17.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:18.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:18.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:18.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:18.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:19.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:19.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:19.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:19.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:20.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:20.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:20.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:20.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:21.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:21.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:21.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:21.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:22.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:22.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:22.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:22.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:23.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:23.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:23.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:23.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:24.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:24.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:24.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:24.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:25.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:25.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:25.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:25.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:26.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:26.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:27.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:27.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:27.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:27.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:28.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:28.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:28.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:28.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:29.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:29.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:29.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:29.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:29.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:29.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:30.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:30.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:31.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:31.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:31.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:31.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:32.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:32.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:32.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:32.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:33.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:33.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:33.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:33.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:34.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:34.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:34.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:34.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:35.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:35.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:35.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:35.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:36.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:36.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:36.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:36.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:37.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:37.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:37.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:37.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:38.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:38.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:38.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:38.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:39.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:39.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:39.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:39.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:40.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:40.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:40.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:40.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:41.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:41.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:41.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:41.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:42.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:42.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:42.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:42.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:43.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:43.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:43.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:43.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:44.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:44.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:44.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:44.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:45.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:45.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:45.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:45.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:46.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:46.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:46.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:46.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:47.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:47.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:47.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:47.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:48.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:48.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:48.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:48.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:49.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:49.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:49.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:49.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:50.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:50.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:50.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:50.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:51.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:51.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:51.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:51.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:52.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:52.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:52.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:52.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:53.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:53.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:53.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:53.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:54.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:54.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:54.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:54.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:55.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:55.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:55.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:55.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:56.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:56.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:56.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:56.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:57.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:57.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:57.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:57.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:58.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:58.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:58.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:58.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:59.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:06:59.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:06:59.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:06:59.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:00.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:00.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:00.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:00.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:01.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:01.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:01.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:01.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:02.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:02.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:02.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:02.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:03.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:03.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:03.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:03.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:04.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:04.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:04.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:04.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:05.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:05.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:05.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:05.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:06.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:06.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:06.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:06.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:07.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:07.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:07.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:07.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:08.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:08.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:08.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:08.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:09.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:09.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:09.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:09.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:10.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:10.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:10.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:10.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:11.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:11.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:11.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:11.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:12.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:12.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:12.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:12.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:13.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:13.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:13.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:14.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:14.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:14.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:14.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:15.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:15.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:15.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:15.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:16.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:16.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:16.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:16.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:17.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:17.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:17.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:17.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:18.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:18.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:18.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:18.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:19.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:19.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:19.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:19.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:20.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:20.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:20.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:20.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:21.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:21.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:21.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:21.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:22.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:22.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:22.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:22.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:23.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:23.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:23.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:23.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:24.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:24.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:24.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:24.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:25.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:25.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:25.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:25.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:26.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:26.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:26.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:26.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:27.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:27.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:27.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:27.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:28.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:28.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:28.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:28.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:29.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:29.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:29.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:29.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:30.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:29.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:30.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:30.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:30.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:30.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:31.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:31.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:31.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:31.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:32.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:32.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:32.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:32.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:33.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:33.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:33.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:34.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:34.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:34.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:34.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:35.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:35.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:35.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:35.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:36.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:36.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:36.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:36.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:37.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:37.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:37.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:37.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:38.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:38.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:38.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:38.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:39.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:39.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:39.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:39.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:40.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:40.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:40.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:40.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:41.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:41.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:41.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:41.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:42.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:42.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:42.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:42.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:43.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:43.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:44.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:44.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:44.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:44.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:45.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:45.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:45.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:45.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:46.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:46.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:46.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:46.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:47.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:47.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:47.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:47.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:48.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:48.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:48.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:48.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:49.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:49.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:49.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:49.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:50.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:50.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:50.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:50.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:51.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:51.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:51.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:51.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:52.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:52.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:52.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:52.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:53.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:53.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:53.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:53.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:54.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:54.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:54.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:54.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:55.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:55.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:55.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:55.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:56.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:56.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:56.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:56.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:57.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:57.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:57.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:57.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:58.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:58.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:58.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:58.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:59.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:07:59.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:07:59.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:07:59.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:00.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:00.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:00.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:00.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:01.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:01.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:01.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:01.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:01.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:01.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:02.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:02.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:02.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:02.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:03.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:03.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:03.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:03.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:04.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:04.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:04.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:04.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:05.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:05.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:05.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:05.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:06.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:06.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:06.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:06.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:07.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:07.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:08.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:08.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:08.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:08.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:09.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:09.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:09.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:09.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:09.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:09.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:10.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:10.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:11.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:11.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:11.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:11.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:11.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:11.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:12.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:12.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:13.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:13.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:13.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:13.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:14.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:14.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:14.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:14.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:15.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:15.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:15.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:15.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:16.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:16.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:16.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:16.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:17.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:17.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:17.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:17.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:18.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:18.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:18.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:18.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:19.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:19.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:19.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:19.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:20.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:20.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:20.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:20.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:21.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:21.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:21.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:21.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:22.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:22.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:22.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:22.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:23.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:23.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:23.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:23.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:24.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:24.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:24.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:24.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:25.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:25.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:25.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:25.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:26.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:26.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:26.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:26.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:27.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:27.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:27.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:27.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:28.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:28.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:28.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:28.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:29.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:29.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:29.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:29.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:30.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:30.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:30.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:30.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:31.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:31.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:31.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:31.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:32.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:32.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:32.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:32.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:33.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:33.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:33.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:33.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:34.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:34.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:34.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:34.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:35.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:35.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:35.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:35.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:36.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:36.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:36.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:36.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:37.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:37.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:37.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:37.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:38.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:38.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:38.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:38.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:39.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:39.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:39.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:39.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:40.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:40.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:40.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:40.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:41.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:41.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:41.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:41.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:42.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:42.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:42.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:42.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:43.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:43.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:43.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:43.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:44.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:44.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:44.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:44.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:45.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:45.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:45.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:45.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:46.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:46.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:46.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:46.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:47.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:47.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:47.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:47.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:48.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:48.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:48.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:48.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:49.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:49.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:49.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:49.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:50.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:50.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:50.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:50.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:51.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:51.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:51.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:51.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:52.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:52.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:52.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:52.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:53.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:53.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:53.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:53.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:54.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:54.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:54.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:54.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:55.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:55.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:55.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:55.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:56.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:56.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:56.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:56.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:57.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:57.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:57.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:57.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:58.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:58.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:58.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:58.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:59.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:08:59.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:08:59.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:08:59.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:00.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:00.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:00.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:00.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:01.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:01.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:01.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:01.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:02.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:02.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:02.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:02.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:03.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:03.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:03.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:03.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:04.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:04.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:04.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:04.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:05.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:05.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:05.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:05.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:06.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:06.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:06.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:06.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:07.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:07.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:07.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:07.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:08.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:08.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:08.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:08.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:09.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:09.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:09.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:09.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:10.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:10.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:10.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:10.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:11.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:11.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:11.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:11.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:12.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:12.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:12.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:12.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:13.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:13.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:13.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:13.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:14.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:14.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:14.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:14.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:15.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:15.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:15.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:15.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:16.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:16.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:16.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:16.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:17.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:17.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:17.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:18.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:18.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:18.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:18.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:19.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:19.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:19.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:19.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:20.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:20.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:20.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:20.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:20.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:20.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:21.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:21.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:22.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:22.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:22.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:22.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:23.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:22.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:23.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:23.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:24.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:24.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:24.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:24.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:24.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:24.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:25.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:25.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:25.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:25.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:26.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:26.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:26.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:26.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:27.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:27.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:27.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:27.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:28.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:28.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:28.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:28.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:29.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:29.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:29.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:29.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:30.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:30.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:31.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:31.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:31.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:31.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:32.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:32.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:32.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:32.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:33.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:33.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:33.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:33.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:34.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:34.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:34.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:34.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:35.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:35.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:35.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:35.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:36.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:36.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:36.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:36.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:37.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:37.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:37.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:37.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:38.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:38.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:38.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:38.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:39.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:39.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:39.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:39.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:40.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:40.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:40.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:40.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:41.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:41.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:41.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:41.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:42.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:42.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:42.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:42.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:43.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:43.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:43.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:43.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:44.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:44.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:44.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:44.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:45.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:45.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:45.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:45.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:46.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:46.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:46.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:46.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:47.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:47.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:47.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:47.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:48.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:48.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:48.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:48.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:49.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:49.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:49.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:49.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:50.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:50.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:50.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:50.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:51.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:51.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:51.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:51.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:52.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:52.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:52.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:52.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:53.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:53.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:53.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:53.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:54.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:54.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:54.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:54.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:55.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:55.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:55.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:55.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:56.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:56.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:56.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:56.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:57.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:57.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:57.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:57.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:58.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:58.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:58.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:58.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:59.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:09:59.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:09:59.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:09:59.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:00.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:00.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:00.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:00.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:01.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:01.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:01.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:01.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:02.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:02.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:02.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:02.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:03.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:03.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:03.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:03.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:04.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:04.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:04.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:04.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:05.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:05.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:05.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:05.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:06.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:06.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:06.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:06.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:07.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:07.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:07.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:07.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:08.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:08.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:08.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:08.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:09.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:09.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:09.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:09.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:10.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:10.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:10.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:10.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:11.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:11.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:11.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:11.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:12.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:12.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:12.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:12.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:13.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:13.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:13.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:13.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:14.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:14.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:14.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:14.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:15.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:15.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:15.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:15.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:16.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:16.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:16.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:16.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:17.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:17.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:17.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:17.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:18.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:18.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:18.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:18.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:19.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:19.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:19.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:19.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:20.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:20.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:20.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:20.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:21.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:21.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:21.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:21.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:22.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:22.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:22.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:22.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:23.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:23.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:23.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:23.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:24.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:24.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:24.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:24.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:25.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:25.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:25.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:25.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:26.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:26.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:26.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:26.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:27.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:27.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:27.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:27.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:28.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:28.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:28.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:28.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:29.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:29.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:29.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:29.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:30.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:30.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:30.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:30.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:31.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:31.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:31.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:31.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:32.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:32.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:32.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:32.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:33.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:33.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:33.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:33.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:34.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:34.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:34.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:34.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:35.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:35.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:35.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:35.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:36.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:36.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:36.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:36.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:37.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:37.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:37.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:37.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:38.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:38.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:38.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:38.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:39.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:39.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:39.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:39.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:40.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:40.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:40.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:40.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:41.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:41.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:41.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:41.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:42.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:42.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:42.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:42.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:43.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:43.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:43.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:43.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:44.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:44.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:44.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:44.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:45.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:45.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:45.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:45.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:46.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:46.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:46.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:46.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:47.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:47.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:47.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:47.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:48.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:48.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:48.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:48.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:49.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:49.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:49.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:49.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:50.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:50.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:50.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:51.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:51.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:51.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:51.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:52.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:52.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:52.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:52.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:53.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:53.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:53.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:53.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:54.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:54.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:54.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:54.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:55.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:55.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:55.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:55.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:56.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:56.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:56.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:56.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:57.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:57.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:57.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:57.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:58.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:58.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:58.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:58.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:59.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:10:59.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:10:59.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:10:59.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:00.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:00.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:00.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:00.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:01.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:01.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:01.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:01.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:02.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:02.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:02.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:02.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:03.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:03.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:03.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:03.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:04.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:04.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:04.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:04.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:05.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:05.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:05.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:05.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:06.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:06.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:06.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:06.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:07.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:07.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:07.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:07.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:08.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:08.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:08.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:08.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:09.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:09.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:09.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:09.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:10.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:10.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:10.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:10.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:11.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:11.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:11.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:11.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:12.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:12.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:12.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:12.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:13.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:13.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:13.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:13.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:14.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:14.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:14.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:14.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:15.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:15.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:15.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:15.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:16.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:16.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:16.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:16.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:17.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:17.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:17.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:17.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:18.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:18.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:18.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:18.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:19.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:19.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:20.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:20.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:20.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:20.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:20.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:20.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:21.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:21.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:22.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:22.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:22.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:22.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:23.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:23.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:23.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:23.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:24.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:24.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:24.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:24.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:25.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:25.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:25.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:25.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:26.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:26.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:26.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:26.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:27.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:27.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:27.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:27.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:28.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:28.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:28.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:28.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:29.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:29.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:29.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:29.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:30.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:30.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:30.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:30.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:30.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:30.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:31.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:31.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:32.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:32.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:32.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:32.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:33.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:33.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:33.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:33.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:34.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:34.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:34.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:34.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:34.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:34.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:35.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:35.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:35.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:35.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:36.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:36.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:36.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:36.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:37.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:37.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:37.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:37.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:38.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:38.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:38.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:38.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:39.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:39.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:39.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:39.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:40.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:40.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:40.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:40.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:41.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:41.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:41.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:41.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:42.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:42.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:42.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:42.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:43.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:43.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:43.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:43.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:44.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:44.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:44.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:44.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:45.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:45.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:45.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:45.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:46.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:46.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:46.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:46.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:47.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:47.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:47.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:47.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:48.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:48.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:48.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:48.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:49.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:49.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:49.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:49.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:50.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:50.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:50.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:50.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:51.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:51.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:51.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:51.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:52.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:52.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:52.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:53.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:53.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:53.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:53.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:54.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:54.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:54.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:54.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:55.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:55.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:55.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:55.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:56.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:56.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:57.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:57.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:57.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:57.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:57.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:57.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:58.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:58.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:58.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:58.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:59.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:11:59.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:11:59.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:11:59.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:00.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:00.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:00.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:00.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:01.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:01.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:01.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:01.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:02.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:02.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:02.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:02.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:03.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:03.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:03.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:03.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:04.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:04.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:04.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:04.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:05.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:05.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:05.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:05.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:06.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:06.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:06.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:06.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:07.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:07.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:07.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:07.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:08.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:08.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:09.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:09.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:09.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:09.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:10.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:10.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:10.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:10.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:11.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:11.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:11.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:11.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:12.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:12.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:12.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:12.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:13.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:13.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:13.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:13.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:14.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:14.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:14.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:14.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:15.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:15.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:15.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:15.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:16.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:16.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:16.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:16.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:17.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:17.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:17.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:17.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:18.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:18.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:18.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:18.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:18.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:18.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:19.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:19.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:19.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:19.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:20.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:20.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:20.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:20.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:21.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:21.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:22.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:22.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:22.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:22.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:23.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:23.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:23.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:23.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:24.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:24.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:24.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:24.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:25.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:25.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:25.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:25.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:26.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:26.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:26.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:26.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:27.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:27.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:27.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:27.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:28.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:28.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:28.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:28.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:29.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:29.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:29.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:29.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:30.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:30.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:30.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:30.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:31.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:31.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:31.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:31.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:32.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:32.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:32.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:32.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:33.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:33.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:33.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:33.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:34.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:34.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:34.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:34.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:35.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:35.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:35.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:35.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:36.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:36.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:36.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:36.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:37.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:37.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:37.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:37.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:38.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:38.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:38.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:39.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:39.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:39.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:39.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:40.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:40.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:40.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:40.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:41.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:41.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:41.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:41.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:42.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:42.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:42.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:42.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:43.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:43.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:43.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:43.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:44.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:44.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:44.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:44.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:45.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:45.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:45.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:45.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:46.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:46.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:46.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:46.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:47.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:47.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:47.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:47.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:48.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:48.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:48.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:48.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:49.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:49.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:49.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:49.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:50.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:50.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:50.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:50.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:51.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:51.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:51.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:51.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:52.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:52.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:52.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:52.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:53.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:53.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:53.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:53.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:54.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:54.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:54.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:54.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:55.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:55.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:55.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:55.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:56.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:56.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:56.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:56.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:57.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:57.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:57.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:57.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:58.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:58.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:58.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:58.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:59.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:12:59.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:12:59.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:12:59.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:00.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:00.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:00.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:00.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:01.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:01.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:01.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:01.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:02.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:02.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:02.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:02.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:03.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:03.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:03.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:03.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:04.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:04.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:04.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:04.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:05.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:05.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:05.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:05.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:06.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:06.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:06.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:06.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:07.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:07.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:07.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:07.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:08.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:08.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:08.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:08.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:09.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:09.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:09.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:09.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:10.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:10.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:10.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:10.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:11.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:11.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:11.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:11.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:12.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:12.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:12.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:12.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:13.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:13.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:13.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:13.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:14.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:14.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:14.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:14.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:15.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:15.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:15.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:15.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:16.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:16.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:16.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:16.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:17.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:17.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:17.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:17.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:18.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:18.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:18.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:18.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:19.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:19.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:19.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:19.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:20.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:20.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:20.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:20.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:21.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:21.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:21.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:21.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:22.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:22.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:22.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:22.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:23.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:23.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:23.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:23.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:24.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:24.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:24.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:24.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:25.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:25.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:25.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:25.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:26.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:26.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:26.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:26.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:27.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:27.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:27.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:27.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:28.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:28.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:28.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:28.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:29.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:29.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:29.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:29.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:30.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:30.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:30.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:30.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:31.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:31.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:31.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:31.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:32.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:32.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:32.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:32.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:33.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:33.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:33.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:33.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:34.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:34.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:34.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:34.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:35.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:35.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:36.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:36.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:36.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:36.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:37.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:37.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:37.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:37.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:38.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:38.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:38.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:38.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:39.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:39.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:39.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:39.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:40.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:40.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:40.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:40.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:41.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:41.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:41.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:41.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:42.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:42.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:42.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:42.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:43.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:43.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:43.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:43.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:44.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:44.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:44.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:44.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:45.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:45.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:45.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:45.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:45.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:45.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:46.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:46.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:46.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:46.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:47.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:47.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:47.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:47.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:48.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:48.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:48.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:48.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:49.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:49.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:49.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:49.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:50.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:50.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:50.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:50.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:51.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:51.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:51.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:51.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:52.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:52.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:52.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:52.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:53.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:53.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:53.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:53.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:54.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:54.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:54.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:54.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:55.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:55.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:55.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:55.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:56.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:56.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:56.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:56.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:57.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:57.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:57.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:57.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:58.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:58.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:58.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:58.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:59.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:13:59.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:13:59.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:13:59.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:00.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:00.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:00.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:00.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:01.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:01.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:01.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:01.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:02.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:02.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:02.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:02.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:03.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:03.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:03.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:03.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:04.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:04.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:04.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:04.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:05.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:05.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:05.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:05.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:06.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:06.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:06.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:06.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:07.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:07.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:07.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:07.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:08.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:08.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:08.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:08.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:09.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:09.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:09.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:09.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:10.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:10.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:10.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:10.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:11.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:11.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:11.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:11.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:12.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:12.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:12.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:12.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:13.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:13.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:13.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:13.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:14.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:14.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:14.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:14.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:15.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:15.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:15.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:15.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:16.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:16.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:16.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:16.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:17.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:17.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:17.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:17.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:18.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:18.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:18.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:18.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:19.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:19.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:19.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:19.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:20.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:20.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:20.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:20.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:21.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:21.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:21.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:21.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:22.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:22.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:22.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:22.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:23.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:23.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:23.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:23.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:24.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:24.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:24.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:24.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:25.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:25.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:25.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:25.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:26.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:26.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:26.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:26.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:27.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:27.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:27.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:27.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:28.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:28.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:28.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:28.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:29.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:29.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:29.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:29.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:30.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:30.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:30.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:30.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:31.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:31.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:31.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:31.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:32.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:32.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:32.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:32.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:33.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:33.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:33.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:33.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:34.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:34.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:34.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:34.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:35.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:35.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:35.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:35.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:36.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:36.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:36.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:36.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:37.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:37.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:37.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:37.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:38.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:38.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:38.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:38.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:39.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:39.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:39.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:39.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:40.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:40.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:40.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:40.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:41.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:41.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:41.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:41.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:42.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:42.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:42.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:42.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:43.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:43.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:43.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:43.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:44.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:44.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:44.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:44.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:45.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:45.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:45.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:45.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:46.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:46.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:46.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:46.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:47.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:47.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:47.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:47.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:48.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:48.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:48.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:48.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:49.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:49.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:49.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:49.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:50.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:50.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:50.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:50.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:51.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:51.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:51.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:51.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:52.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:52.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:52.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:52.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:53.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:53.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:53.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:53.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:54.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:54.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:54.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:55.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:55.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:55.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:55.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:56.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:56.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:57.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:57.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:57.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:57.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:57.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:57.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:58.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:58.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:59.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:14:59.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:14:59.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:14:59.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:00.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:00.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:00.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:00.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:01.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:01.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:01.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:01.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:02.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:02.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:02.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:02.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:03.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:03.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:03.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:03.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:04.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:04.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:04.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:04.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:05.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:05.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:05.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:05.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:06.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:06.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:06.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:06.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:07.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:07.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:07.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:07.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:08.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:08.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:08.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:08.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:09.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:09.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:09.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:09.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:10.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:10.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:10.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:10.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:11.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:11.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:11.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:11.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:12.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:12.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:12.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:12.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:13.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:13.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:13.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:13.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:14.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:14.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:14.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:14.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:15.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:15.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:15.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:15.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:16.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:16.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:16.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:16.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:17.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:17.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:17.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:17.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:18.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:18.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:18.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:18.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:19.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:19.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:19.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:19.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:20.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:20.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:20.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:20.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:21.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:21.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:21.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:21.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:22.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:22.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:22.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:22.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:23.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:23.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:23.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:23.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:24.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:24.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:24.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:24.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:25.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:25.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:25.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:25.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:26.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:26.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:26.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:26.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:27.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:27.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:27.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:27.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:28.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:28.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:28.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:28.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:29.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:29.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:29.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:29.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:30.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:30.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:30.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:30.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:31.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:31.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:31.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:31.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:32.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:32.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:32.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:32.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:33.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:33.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:33.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:33.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:34.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:34.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:34.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:34.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:35.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:35.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:35.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:35.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:36.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:36.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:36.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:36.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:37.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:37.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:37.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:37.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:38.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:38.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:38.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:38.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:39.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:39.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:39.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:39.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:40.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:40.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:40.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:40.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:41.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:41.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:41.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:41.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:42.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:42.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:42.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:42.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:43.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:43.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:43.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:43.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:44.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:44.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:44.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:44.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:45.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:45.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:45.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:45.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:46.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:46.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:46.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:46.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:47.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:47.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:47.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:47.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:48.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:48.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:48.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:48.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:49.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:49.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:49.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:49.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:50.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:50.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:50.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:50.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:51.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:51.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:51.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:51.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:52.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:52.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:52.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:52.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:53.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:53.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:53.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:53.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:54.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:54.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:54.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:54.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:55.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:55.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:55.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:55.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:56.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:56.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:56.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:56.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:57.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:57.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:57.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:57.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:58.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:58.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:58.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:58.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:59.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:15:59.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:15:59.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:15:59.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:00.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:00.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:00.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:00.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:01.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:01.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:01.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:01.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:02.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:02.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:02.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:02.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:03.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:03.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:03.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:03.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:04.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:04.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:04.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:04.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:05.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:05.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:05.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:05.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:06.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:06.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:06.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:06.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:07.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:07.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:07.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:07.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:08.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:08.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:08.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:08.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:09.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:09.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:09.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:09.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:10.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:10.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:10.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:10.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:11.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:11.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:11.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:11.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:12.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:12.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:12.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:12.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:13.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:13.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:13.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:13.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:14.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:14.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:14.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:14.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:15.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:15.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:15.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:15.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:16.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:16.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:16.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:16.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:17.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:17.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:17.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:17.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:18.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:18.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:18.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:18.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:19.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:19.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:19.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:19.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:20.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:20.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:20.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:20.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:21.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:21.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:21.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:21.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:22.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:22.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:22.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:22.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:23.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:23.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:23.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:23.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:23.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:23.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:24.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:24.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:25.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:25.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:25.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:25.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:26.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:26.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:26.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:26.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:27.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:27.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:27.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:27.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:28.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:28.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:28.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:28.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:29.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:29.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:29.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:29.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:30.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:30.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:30.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:30.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:31.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:31.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:31.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:31.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:32.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:32.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:32.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:32.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:33.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:33.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:33.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:33.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:34.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:34.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:34.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:34.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:35.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:35.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:35.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:35.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:36.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:36.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:36.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:36.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:37.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:37.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:37.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:37.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:38.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:38.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:38.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:38.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:39.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:39.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:39.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:39.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:40.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:40.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:40.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:40.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:41.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:41.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:41.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:41.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:42.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:42.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:42.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:42.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:43.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:43.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:43.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:43.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:44.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:44.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:44.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:44.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:45.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:45.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:45.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:45.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:46.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:46.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:46.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:46.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:47.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:47.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:47.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:47.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:48.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:48.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:48.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:48.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:49.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:49.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:49.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:49.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:50.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:50.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:50.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:50.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:51.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:51.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:51.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:51.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:52.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:52.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:52.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:52.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:53.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:53.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:53.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:53.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:54.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:54.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:54.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:54.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:55.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:55.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:55.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:55.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:56.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:56.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:56.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:57.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:57.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:57.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:57.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:58.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:58.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:58.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:58.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:59.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:16:59.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:16:59.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:16:59.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:00.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:00.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:00.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:00.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:01.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:01.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:01.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:01.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:02.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:02.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:02.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:02.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:03.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:03.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:03.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:03.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:04.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:04.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:04.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:04.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:05.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:05.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:05.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:05.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:06.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:06.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:06.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:06.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:07.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:07.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:07.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:07.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:08.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:08.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:08.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:08.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:09.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:09.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:09.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:09.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:10.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:10.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:10.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:10.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:11.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:11.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:11.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:11.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:12.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:12.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:12.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:12.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:13.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:13.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:13.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:13.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:14.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:14.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:14.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:14.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:15.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:15.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:15.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:15.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:16.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:16.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:16.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:16.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:17.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:17.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:17.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:17.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:18.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:18.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:18.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:18.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:19.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:19.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:19.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:19.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:20.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:20.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:20.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:20.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:21.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:21.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:21.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:21.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:22.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:22.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:22.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:22.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:23.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:23.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:23.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:23.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:24.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:24.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:24.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:24.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:25.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:25.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:25.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:25.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:26.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:26.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:26.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:26.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:27.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:27.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:27.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:27.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:28.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:28.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:28.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:28.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:29.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:29.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:29.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:29.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:30.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:30.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:30.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:30.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:31.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:31.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:31.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:31.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:32.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:32.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:32.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:32.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:33.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:33.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:33.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:33.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:34.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:34.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:34.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:34.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:35.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:35.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:35.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:35.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:36.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:36.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:36.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:36.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:37.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:37.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:37.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:37.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:38.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:38.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:38.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:38.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:39.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:39.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:39.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:39.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:40.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:40.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:40.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:40.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:41.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:41.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:41.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:41.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:42.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:42.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:42.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:42.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:43.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:43.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:43.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:43.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:44.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:44.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:44.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:44.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:45.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:45.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:45.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:45.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:46.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:46.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:46.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:46.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:47.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:47.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:47.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:47.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:48.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:48.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:48.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:48.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:49.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:49.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:49.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:49.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:50.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:50.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:50.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:50.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:51.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:51.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:51.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:51.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:52.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:52.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:52.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:52.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:53.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:53.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:53.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:53.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:54.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:54.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:54.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:54.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:55.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:55.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:55.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:55.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:56.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:56.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:56.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:56.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:57.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:57.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:57.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:57.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:58.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:58.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:58.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:58.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:59.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:17:59.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:17:59.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:17:59.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:00.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:00.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:00.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:00.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:01.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:01.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:01.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:01.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:02.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:02.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:02.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:02.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:03.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:03.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:03.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:03.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:04.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:04.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:04.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:04.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:05.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:05.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:05.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:05.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:06.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:06.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:06.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:06.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:07.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:07.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:07.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:07.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:08.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:08.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:08.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:08.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:09.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:09.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:09.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:09.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:10.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:10.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:10.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:10.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:11.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:11.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:11.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:11.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:12.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:12.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:12.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:12.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:13.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:13.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:13.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:13.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:14.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:14.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:14.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:14.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:15.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:15.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:15.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:15.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:16.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:16.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:16.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:16.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:17.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:17.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:17.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:17.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:18.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:18.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:18.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:18.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:19.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:19.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:19.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:19.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:20.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:20.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:20.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:20.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:21.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:21.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:21.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:21.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:22.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:22.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:22.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:22.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:23.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:23.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:23.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:23.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:24.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:24.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:24.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:24.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:25.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:25.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:25.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:25.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:26.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:26.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:26.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:26.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:27.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:27.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:27.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:27.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:28.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:28.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:28.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:28.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:29.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:29.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:29.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:29.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:30.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:30.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:30.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:30.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:31.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:31.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:31.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:31.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:32.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:32.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:32.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:32.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:33.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:33.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:33.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:33.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:34.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:34.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:34.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:34.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:35.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:35.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:35.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:35.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:36.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:36.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:36.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:36.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:37.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:37.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:37.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:37.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:38.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:38.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:38.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:38.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:39.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:39.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:39.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:39.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:40.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:40.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:40.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:40.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:41.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:41.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:41.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:41.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:42.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:42.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:42.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:42.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:43.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:43.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:43.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:43.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:44.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:44.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:44.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:44.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:45.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:45.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:45.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:45.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:46.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:46.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:46.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:46.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:47.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:47.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:47.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:47.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:48.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:48.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:48.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:48.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:49.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:49.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:49.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:49.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:50.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:50.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:50.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:50.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:51.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:51.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:51.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:51.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:52.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:52.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:52.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:52.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:53.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:53.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:53.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:53.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:54.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:54.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:54.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:54.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:55.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:55.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:55.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:55.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:56.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:56.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:56.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:56.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:57.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:57.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:57.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:57.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:58.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:58.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:58.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:58.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:59.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:18:59.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:18:59.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:18:59.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:00.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:00.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:00.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:00.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:01.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:01.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:01.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:01.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:02.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:02.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:02.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:02.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:03.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:03.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:03.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:03.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:04.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:04.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:04.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:04.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:05.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:05.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:05.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:05.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:06.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:06.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:06.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:06.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:07.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:07.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:07.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:07.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:08.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:08.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:08.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:08.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:09.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:09.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:09.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:09.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:10.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:10.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:10.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:10.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:11.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:11.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:11.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:11.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:12.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:12.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:12.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:12.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:13.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:13.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:13.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:13.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:14.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:14.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:14.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:14.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:15.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:15.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:15.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:15.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:16.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:16.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:16.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:16.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:17.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:17.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:17.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:17.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:18.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:18.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:18.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:18.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:19.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:19.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:19.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:19.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:20.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:20.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:20.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:20.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:21.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:21.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:21.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:21.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:22.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:22.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:22.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:22.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:23.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:23.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:23.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:23.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:24.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:24.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:24.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:24.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:25.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:25.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:25.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:25.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:26.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:26.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:26.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:26.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:27.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:27.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:27.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:27.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:28.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:28.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:28.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:28.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:29.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:29.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:29.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:29.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:30.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:30.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:30.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:30.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:31.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:31.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:31.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:31.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:32.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:32.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:32.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:32.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:33.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:33.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:33.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:33.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:34.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:34.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:34.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:34.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:35.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:35.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:35.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:35.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:36.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:36.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:36.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:36.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:37.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:37.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:37.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:37.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:38.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:38.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:38.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:38.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:39.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:39.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:39.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:39.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:40.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:40.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:40.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:40.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:41.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:41.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:41.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:41.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:42.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:42.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:42.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:42.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:43.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:43.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:43.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:43.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:44.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:44.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:44.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:44.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:45.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:45.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:45.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:45.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:46.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:46.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:46.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:46.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:47.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:47.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:47.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:47.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:48.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:48.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:48.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:48.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:49.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:49.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:49.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:49.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:50.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:50.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:50.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:50.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:51.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:51.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:51.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:51.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:52.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:52.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:52.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:52.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:53.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:53.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:53.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:53.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:54.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:54.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:54.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:54.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:55.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:55.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:55.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:55.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:56.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:56.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:56.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:56.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:57.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:57.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:57.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:57.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:58.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:58.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:58.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:58.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:59.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:19:59.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:19:59.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:19:59.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:00.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:00.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:00.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:00.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:01.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:01.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:01.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:01.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:02.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:02.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:02.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:02.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:03.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:03.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:03.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:03.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:04.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:04.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:04.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:04.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:05.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:05.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:05.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:05.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:06.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:06.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:06.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:06.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:07.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:07.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:07.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:07.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:08.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:08.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:08.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:08.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:09.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:09.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:09.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:09.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:10.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:10.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:10.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:10.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:11.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:11.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:11.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:11.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:12.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:12.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:12.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:12.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:13.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:13.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:13.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:13.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:14.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:14.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:14.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:14.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:15.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:15.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:15.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:15.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:16.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:16.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:16.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:16.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:17.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:17.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:17.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:17.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:18.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:18.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:18.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:18.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:19.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:19.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:19.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:19.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:20.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:20.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:20.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:20.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:21.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:21.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:21.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:21.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:22.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:22.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:22.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:22.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:23.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:23.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:23.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:23.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:24.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:24.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:24.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:24.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:25.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:25.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:25.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:25.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:26.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:26.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:26.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:26.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:27.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:27.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:27.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:27.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:28.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:28.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:28.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:28.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:29.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:29.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:29.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:29.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:30.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:30.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:30.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:30.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:31.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:31.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:31.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:31.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:32.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:32.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:32.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:32.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:33.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:33.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:33.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:33.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:34.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:34.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:34.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:34.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:35.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:35.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:35.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:35.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:36.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:36.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:36.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:36.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:37.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:37.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:37.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:37.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:38.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:38.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:38.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:38.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:39.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:39.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:39.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:39.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:40.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:40.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:40.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:40.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:41.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:41.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:41.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:41.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:42.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:42.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:42.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:42.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:43.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:43.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:43.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:43.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:44.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:44.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:44.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:44.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:45.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:45.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:46.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:46.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:46.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:46.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:47.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:47.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:47.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:47.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:47.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:47.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:48.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:48.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:48.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:48.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:49.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:49.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:49.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:49.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:50.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:50.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:50.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:50.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:51.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:51.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:52.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:52.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:52.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:52.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:53.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:53.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:53.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:53.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:54.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:54.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:54.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:54.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:55.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:55.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:55.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:55.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:56.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:56.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:56.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:56.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:57.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:57.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:57.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:57.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:58.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:58.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:58.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:58.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:59.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:20:59.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:20:59.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:20:59.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:00.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:00.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:00.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:00.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:01.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:01.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:01.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:01.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:02.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:02.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:02.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:02.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:03.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:03.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:03.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:03.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:04.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:04.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:04.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:04.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:05.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:05.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:05.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:05.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:06.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:06.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:06.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:06.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:07.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:07.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:07.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:07.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:08.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:08.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:08.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:08.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:09.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:09.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:09.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:09.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:10.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:10.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:10.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:10.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:11.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:11.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:11.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:11.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:12.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:12.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:12.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:12.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:13.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:13.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:13.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:13.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:14.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:14.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:14.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:14.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:15.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:15.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:15.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:15.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:16.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:16.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:16.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:16.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:17.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:17.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:17.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:17.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:18.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:18.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:18.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:18.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:19.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:19.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:19.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:19.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:20.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:20.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:20.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:20.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:21.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:21.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:21.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:21.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:22.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:22.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:22.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:22.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:23.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:23.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:23.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:23.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:24.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:24.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:24.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:24.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:25.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:25.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:25.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:25.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:26.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:26.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:26.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:26.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:27.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:27.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:27.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:27.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:28.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:28.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:28.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:28.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:29.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:29.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:29.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:29.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:30.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:30.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:30.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:30.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:31.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:31.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:31.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:31.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:32.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:32.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:32.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:32.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:33.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:33.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:33.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:33.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:34.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:34.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:34.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:34.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:35.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:35.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:35.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:36.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:36.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:36.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:36.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:37.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:37.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:37.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:37.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:38.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:38.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:38.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:38.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:39.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:39.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:39.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:39.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:40.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:40.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:40.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:40.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:41.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:41.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:41.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:41.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:42.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:42.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:42.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:42.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:43.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:43.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:43.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:43.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:44.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:44.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:44.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:44.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:45.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:45.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:45.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:45.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:46.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:46.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:46.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:46.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:47.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:47.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:47.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:47.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:48.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:48.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:48.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:48.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:49.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:49.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:49.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:49.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:50.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:50.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:50.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:50.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:51.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:51.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:51.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:51.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:52.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:52.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:52.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:52.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:53.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:53.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:53.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:53.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:54.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:54.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:54.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:54.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:55.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:55.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:55.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:55.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:56.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:56.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:56.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:56.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:57.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:57.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:57.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:57.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:58.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:58.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:58.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:58.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:59.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:21:59.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:21:59.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:21:59.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:00.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:00.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:00.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:00.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:01.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:01.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:01.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:01.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:02.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:02.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:02.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:02.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:03.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:03.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:03.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:03.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:04.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:04.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:04.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:04.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:05.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:05.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:05.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:05.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:06.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:06.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:06.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:06.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:07.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:07.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:07.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:07.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:08.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:08.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:08.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:08.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:09.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:09.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:09.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:09.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:10.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:10.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:10.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:10.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:11.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:11.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:11.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:11.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:12.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:12.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:12.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:12.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:13.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:13.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:13.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:13.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:14.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:14.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:14.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:14.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:15.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:15.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:15.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:15.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:16.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:16.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:16.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:16.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:17.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:17.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:17.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:17.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:18.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:18.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:18.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:18.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:19.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:19.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:19.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:19.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:20.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:20.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:20.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:20.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:21.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:21.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:21.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:21.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:22.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:22.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:22.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:22.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:23.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:23.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:23.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:23.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:24.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:24.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:24.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:24.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:25.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:25.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:25.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:25.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:26.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:26.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:26.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:26.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:27.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:27.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:27.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:27.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:28.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:28.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:28.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:28.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:29.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:29.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:29.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:29.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:30.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:30.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:30.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:30.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:31.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:31.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:31.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:31.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:32.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:32.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:32.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:32.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:33.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:33.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:33.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:33.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:34.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:34.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:34.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:34.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:35.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:35.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:35.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:35.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:36.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:36.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:36.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:36.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:37.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:37.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:37.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:37.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:38.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:38.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:38.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:38.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:39.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:39.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:39.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:39.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:40.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:40.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:40.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:40.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:41.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:41.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:41.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:41.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:42.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:42.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:42.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:42.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:43.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:43.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:43.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:43.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:44.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:44.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:44.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:44.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:45.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:45.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:45.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:45.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:46.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:46.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:46.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:46.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:47.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:47.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:47.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:47.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:48.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:48.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:48.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:48.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:49.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:49.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:49.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:49.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:50.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:50.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:50.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:50.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:51.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:51.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:51.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:51.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:52.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:52.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:52.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:52.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:53.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:53.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:53.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:53.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:54.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:54.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:54.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:54.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:55.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:55.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:55.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:55.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:56.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:56.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:56.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:56.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:57.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:57.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:57.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:57.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:58.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:58.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:58.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:58.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:59.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:22:59.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:22:59.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:22:59.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:00.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:00.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:00.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:00.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:01.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:01.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:01.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:01.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:02.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:02.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:02.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:02.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:03.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:03.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:03.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:03.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:04.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:04.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:04.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:04.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:05.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:05.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:05.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:05.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:06.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:06.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:06.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:06.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:07.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:07.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:07.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:07.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:08.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:08.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:08.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:08.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:09.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:09.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:09.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:09.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:10.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:10.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:10.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:10.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:11.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:11.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:11.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:11.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:12.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:12.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:12.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:12.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:13.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:13.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:13.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:13.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:14.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:14.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:14.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:14.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:15.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:15.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:15.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:15.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:16.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:16.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:16.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:16.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:17.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:17.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:17.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:17.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:18.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:18.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:18.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:18.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:19.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:19.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:19.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:19.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:20.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:20.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:20.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:20.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:21.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:21.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:21.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:21.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:22.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:22.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:22.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:22.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:23.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:23.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:23.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:23.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:24.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:24.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:24.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:24.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:25.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:25.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:25.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:25.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:26.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:26.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:26.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:26.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:27.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:27.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:27.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:27.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:28.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:28.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:28.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:28.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:29.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:29.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:29.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:29.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:30.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:30.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:30.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:30.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:31.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:31.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:31.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:31.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:32.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:32.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:32.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:32.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:33.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:33.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:33.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:33.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:34.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:34.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:34.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:34.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:35.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:35.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:35.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:35.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:36.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:36.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:36.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:36.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:37.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:37.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:37.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:37.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:38.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:38.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:38.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:38.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:39.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:39.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:39.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:39.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:40.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:40.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:40.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:40.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:41.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:41.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:41.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:41.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:42.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:42.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:42.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:42.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:43.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:43.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:43.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:43.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:44.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:44.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:44.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:44.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:45.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:45.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:45.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:45.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:46.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:46.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:46.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:46.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:47.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:47.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:47.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:47.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:48.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:48.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:48.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:48.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:49.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:49.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:49.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:49.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:50.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:50.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:50.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:50.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:51.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:51.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:51.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:51.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:52.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:52.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:52.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:52.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:53.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:53.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:53.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:53.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:54.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:54.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:54.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:54.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:55.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:55.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:55.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:55.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:56.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:56.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:56.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:56.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:57.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:57.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:57.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:57.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:58.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:58.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:58.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:58.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:59.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:23:59.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:23:59.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:23:59.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:00.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:00.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:00.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:00.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:01.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:01.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:01.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:01.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:02.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:02.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:02.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:02.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:03.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:03.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:03.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:03.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:04.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:04.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:04.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:04.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:05.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:05.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:05.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:05.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:06.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:06.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:06.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:06.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:07.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:07.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:07.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:07.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:08.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:08.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:08.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:08.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:09.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:09.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:09.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:09.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:10.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:10.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:10.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:10.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:11.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:11.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:11.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:11.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:12.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:12.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:12.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:12.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:13.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:13.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:13.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:13.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:14.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:14.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:14.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:14.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:15.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:15.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:15.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:15.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:16.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:16.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:16.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:16.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:17.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:17.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:17.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:17.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:18.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:18.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:18.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:18.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:19.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:19.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:19.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:19.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:20.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:20.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:20.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:20.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:21.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:21.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:21.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:21.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:22.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:22.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:22.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:22.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:23.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:23.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:23.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:23.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:24.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:24.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:24.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:24.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:25.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:25.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:25.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:25.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:26.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:26.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:26.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:26.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:27.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:27.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:27.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:27.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:28.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:28.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:28.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:28.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:29.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:28.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:29.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:29.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:30.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:30.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:30.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:30.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:30.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:30.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:31.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:31.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:32.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:32.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:32.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:32.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:33.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:33.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:33.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:33.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:34.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:34.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:34.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:34.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:35.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:35.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:35.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:35.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:36.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:36.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:36.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:36.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:37.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:37.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:37.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:37.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:38.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:38.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:38.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:38.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:39.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:39.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:39.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:39.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:40.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:40.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:40.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:40.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:41.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:41.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:41.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:41.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:42.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:42.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:42.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:42.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:43.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:43.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:43.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:43.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:44.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:44.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:44.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:44.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:45.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:45.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:45.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:45.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:46.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:46.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:46.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:46.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:47.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:47.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:47.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:47.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:48.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:47.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:48.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:48.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:49.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:49.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:49.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:49.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:50.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:50.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:50.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:50.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:51.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:51.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:51.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:51.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:52.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:52.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:52.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:52.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:53.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:53.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:53.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:53.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:54.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:54.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:54.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:54.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:55.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:55.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:55.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:55.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:56.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:56.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:56.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:56.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:57.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:57.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:57.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:57.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:58.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:58.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:58.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:58.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:59.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:24:59.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:24:59.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:24:59.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:00.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:00.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:00.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:00.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:01.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:01.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:01.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:01.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:02.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:02.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:02.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:02.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:03.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:03.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:03.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:03.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:04.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:04.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:04.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:04.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:05.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:05.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:05.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:05.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:06.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:06.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:06.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:06.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:07.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:07.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:07.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:07.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:08.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:08.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:08.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:08.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:09.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:09.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:09.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:09.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:10.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:10.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:10.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:10.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:11.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:11.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:11.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:11.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:12.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:12.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:12.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:12.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:13.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:13.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:13.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:13.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:14.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:14.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:14.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:14.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:15.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:15.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:15.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:15.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:16.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:16.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:16.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:16.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:17.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:17.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:17.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:17.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:18.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:18.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:18.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:18.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:19.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:19.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:19.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:19.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:20.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:20.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:20.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:20.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:21.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:21.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:21.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:21.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:22.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:22.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:22.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:22.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:23.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:23.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:23.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:23.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:24.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:24.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:24.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:24.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:25.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:25.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:25.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:25.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:26.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:26.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:26.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:26.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:27.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:27.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:27.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:27.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:28.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:28.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:28.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:28.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:29.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:29.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:30.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:30.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:30.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:30.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:31.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:31.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:31.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:31.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:32.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:32.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:32.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:32.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:33.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:33.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:33.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:33.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:34.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:34.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:34.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:34.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:35.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:35.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:35.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:35.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:36.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:36.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:36.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:36.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:37.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:37.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:37.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:37.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:38.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:38.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:38.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:38.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:39.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:39.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:39.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:39.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:40.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:40.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:40.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:40.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:41.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:41.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:41.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:41.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:42.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:42.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:42.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:42.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:43.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:43.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:43.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:43.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:44.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:44.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:44.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:44.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:45.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:45.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:45.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:45.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:46.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:46.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:46.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:46.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:47.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:47.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:47.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:47.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:48.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:48.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:48.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:48.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:49.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:49.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:49.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:49.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:50.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:50.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:50.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:50.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:51.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:51.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:51.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:51.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:52.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:52.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:52.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:52.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:53.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:53.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:53.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:53.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:54.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:54.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:54.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:54.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:55.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:55.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:55.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:55.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:56.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:56.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:56.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:56.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:57.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:57.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:57.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:57.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:58.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:58.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:58.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:58.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:59.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:25:59.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:25:59.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:25:59.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:00.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:00.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:00.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:00.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:01.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:01.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:01.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:01.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:02.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:02.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:02.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:02.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:03.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:03.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:03.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:03.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:04.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:04.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:04.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:04.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:05.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:05.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:05.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:05.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:06.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:06.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:06.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:06.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:07.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:07.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:07.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:07.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:08.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:08.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:08.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:08.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:09.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:09.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:09.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:09.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:10.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:10.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:10.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:10.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:11.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:11.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:11.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:11.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:12.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:12.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:12.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:12.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:13.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:13.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:13.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:13.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:14.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:14.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:14.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:14.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:15.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:15.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:15.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:15.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:16.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:16.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:16.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:16.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:17.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:17.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:17.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:17.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:18.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:18.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:18.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:18.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:19.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:19.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:19.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:19.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:20.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:20.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:20.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:20.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:21.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:21.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:21.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:21.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:22.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:22.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:22.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:22.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:23.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:23.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:23.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:23.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:24.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:24.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:24.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:24.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:25.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:25.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:25.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:25.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:26.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:26.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:26.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:26.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:27.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:27.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:27.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:27.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:28.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:28.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:28.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:28.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:29.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:29.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:29.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:29.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:30.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:30.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:30.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:30.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:31.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:31.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:31.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:31.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:32.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:32.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:32.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:32.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:33.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:33.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:33.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:33.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:34.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:34.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:34.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:34.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:35.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:35.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:35.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:35.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:36.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:36.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:36.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:36.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:37.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:37.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:37.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:37.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:38.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:38.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:38.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:38.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:39.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:39.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:39.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:39.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:40.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:40.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:40.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:40.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:41.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:41.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:41.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:41.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:42.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:42.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:42.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:42.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:43.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:43.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:43.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:43.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:44.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:44.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:44.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:44.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:45.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:45.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:45.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:45.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:46.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:46.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:46.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:46.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:47.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:47.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:47.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:47.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:48.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:48.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:48.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:48.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:49.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:49.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:49.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:49.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:50.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:50.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:50.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:50.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:51.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:51.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:51.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:51.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:52.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:52.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:52.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:52.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:53.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:53.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:53.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:53.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:54.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:54.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:54.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:54.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:55.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:55.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:55.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:55.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:56.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:56.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:56.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:56.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:57.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:57.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:57.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:57.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:58.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:58.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:58.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:58.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:59.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:26:59.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:26:59.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:26:59.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:00.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:00.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:00.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:00.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:01.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:01.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:01.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:01.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:02.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:02.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:02.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:02.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:03.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:03.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:03.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:03.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:04.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:04.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:04.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:04.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:05.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:05.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:05.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:05.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:06.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:06.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:06.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:06.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:07.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:07.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:07.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:07.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:08.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:08.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:08.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:08.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:09.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:09.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:09.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:09.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:10.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:10.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:10.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:10.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:11.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:11.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:11.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:11.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:12.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:12.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:12.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:12.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:13.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:13.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:13.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:13.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:14.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:14.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:14.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:14.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:15.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:15.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:15.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:15.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:16.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:16.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:16.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:16.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:17.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:17.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:17.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:17.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:18.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:18.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:18.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:18.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:19.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:19.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:19.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:19.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:20.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:20.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:20.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:20.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:21.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:21.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:21.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:21.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:22.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:22.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:22.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:22.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:23.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:23.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:23.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:23.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:24.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:24.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:24.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:24.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:25.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:25.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:25.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:25.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:26.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:26.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:26.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:26.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:27.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:27.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:27.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:27.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:28.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:28.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:28.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:28.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:29.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:29.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:29.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:29.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:30.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:30.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:30.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:30.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:31.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:31.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:31.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:31.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:32.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:32.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:32.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:32.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:33.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:33.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:33.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:33.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:34.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:34.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:34.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:34.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:35.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:35.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:35.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:35.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:36.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:36.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:36.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:36.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:37.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:37.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:37.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:37.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:38.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:38.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:38.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:38.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:39.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:39.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:39.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:39.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:40.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:40.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:40.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:40.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:41.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:41.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:41.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:41.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:42.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:42.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:42.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:42.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:43.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:43.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:43.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:43.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:44.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:44.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:44.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:44.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:45.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:45.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:45.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:45.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:46.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:46.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:46.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:46.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:47.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:47.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:47.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:47.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:48.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:48.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:48.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:48.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:49.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:49.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:49.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:49.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:50.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:50.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:50.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:50.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:51.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:51.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:51.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:51.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:52.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:52.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:52.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:52.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:53.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:53.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:53.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:53.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:54.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:54.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:54.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:54.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:55.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:55.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:55.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:55.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:56.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:56.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:56.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:56.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:57.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:57.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:57.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:57.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:58.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:58.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:58.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:58.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:59.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:27:59.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:27:59.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:27:59.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:00.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:00.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:00.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:00.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:01.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:01.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:01.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:01.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:02.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:02.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:02.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:02.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:03.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:03.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:03.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:03.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:04.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:04.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:04.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:04.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:05.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:05.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:05.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:05.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:06.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:06.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:06.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:06.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:07.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:07.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:07.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:07.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:08.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:08.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:08.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:08.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:09.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:09.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:09.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:09.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:10.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:10.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:10.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:10.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:11.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:11.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:11.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:11.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:12.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:12.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:12.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:12.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:13.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:13.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:13.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:13.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:14.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:14.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:14.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:14.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:15.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:15.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:15.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:15.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:16.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:16.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:16.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:16.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:17.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:17.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:18.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:18.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:18.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:18.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:19.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:19.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:19.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:19.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:20.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:20.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:20.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:20.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:21.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:21.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:21.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:21.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:21.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:21.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:22.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:22.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:22.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:22.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:23.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:23.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:23.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:23.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:24.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:24.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:24.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:24.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:25.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:25.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:25.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:25.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:26.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:26.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:26.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:26.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:27.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:27.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:27.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:27.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:28.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:28.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:28.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:28.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:29.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:29.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:29.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:29.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:30.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:30.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:30.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:30.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:31.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:31.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:31.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:31.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:32.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:32.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:32.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:32.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:33.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:33.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:33.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:33.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:34.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:34.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:34.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:34.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:35.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:35.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:35.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:35.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:36.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:36.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:36.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:36.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:37.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:37.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:37.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:37.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:38.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:38.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:39.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:39.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:39.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:39.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:40.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:40.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:40.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:40.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:41.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:41.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:41.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:41.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:42.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:42.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:42.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:42.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:43.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:43.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:43.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:43.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:44.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:44.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:44.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:44.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:45.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:45.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:45.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:45.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:46.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:46.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:46.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:46.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:47.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:47.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:47.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:47.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:48.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:48.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:48.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:48.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:48.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:48.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:49.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:49.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:49.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:49.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:50.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:50.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:50.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:50.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:51.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:51.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:51.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:51.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:52.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:52.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:52.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:52.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:53.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:53.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:53.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:53.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:54.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:54.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:54.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:54.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:55.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:55.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:55.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:55.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:56.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:56.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:56.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:56.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:57.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:57.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:57.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:57.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:58.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:58.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:58.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:58.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:59.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:28:59.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:28:59.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:28:59.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:00.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:00.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:00.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:00.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:01.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:01.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:01.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:01.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:02.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:02.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:02.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:02.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:03.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:03.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:03.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:03.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:04.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:04.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:04.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:04.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:05.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:05.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:05.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:05.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:06.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:06.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:06.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:06.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:07.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:07.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:07.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:07.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:08.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:08.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:08.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:08.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:09.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:09.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:09.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:09.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:10.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:10.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:10.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:10.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:11.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:11.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:11.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:11.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:12.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:12.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:12.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:12.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:13.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:13.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:13.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:13.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:14.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:14.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:14.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:14.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:15.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:15.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:15.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:15.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:16.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:16.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:16.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:16.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:17.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:17.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:17.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:17.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:18.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:18.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:18.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:18.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:19.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:19.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:19.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:19.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:20.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:20.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:20.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:20.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:21.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:21.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:21.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:21.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:22.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:22.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:22.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:22.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:23.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:23.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:23.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:23.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:24.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:24.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:24.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:24.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:25.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:25.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:25.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:25.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:26.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:26.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:26.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:26.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:27.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:27.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:27.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:27.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:28.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:28.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:28.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:28.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:29.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:29.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:29.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:29.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:30.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:30.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:30.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:30.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:31.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:31.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:31.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:31.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:32.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:32.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:32.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:32.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:33.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:33.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:33.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:33.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:34.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:34.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:34.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:34.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:35.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:35.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:35.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:35.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:36.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:36.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:36.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:36.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:37.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:37.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:37.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:37.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:38.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:38.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:38.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:38.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:39.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:39.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:39.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:39.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:40.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:40.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:40.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:40.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:41.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:41.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:41.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:41.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:42.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:42.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:42.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:42.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:43.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:43.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:43.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:43.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:44.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:44.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:44.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:44.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:45.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:45.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:45.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:45.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:46.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:46.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:46.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:46.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:47.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:47.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:47.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:47.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:48.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:48.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:48.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:48.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:49.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:49.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:49.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:49.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:50.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:50.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:50.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:50.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:51.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:51.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:51.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:51.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:52.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:52.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:52.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:52.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:53.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:53.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:53.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:53.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:54.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:54.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:54.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:54.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:55.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:55.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:55.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:55.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:56.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:56.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:56.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:56.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:57.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:57.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:57.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:57.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:58.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:58.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:58.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:58.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:59.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:29:59.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:29:59.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:29:59.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:00.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:00.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:00.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:00.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:01.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:01.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:01.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:01.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:02.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:02.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:02.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:02.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:03.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:03.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:03.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:03.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:04.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:04.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:04.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:04.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:05.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:05.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:05.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:05.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:06.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:06.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:06.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:06.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:07.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:07.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:07.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:07.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:08.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:08.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:08.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:08.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:09.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:09.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:09.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:09.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:10.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:10.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:10.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:10.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:11.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:11.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:11.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:11.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:12.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:12.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:12.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:12.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:13.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:13.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:13.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:13.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:14.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:14.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:14.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:14.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:15.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:15.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:15.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:15.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:16.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:16.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:16.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:16.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:17.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:17.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:17.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:17.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:18.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:18.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:18.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:18.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:19.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:19.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:19.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:19.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:20.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:20.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:20.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:20.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:21.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:21.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:21.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:21.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:22.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:22.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:22.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:22.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:23.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:23.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:23.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:23.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:24.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:24.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:24.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:24.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:25.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:25.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:25.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:25.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:26.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:26.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:26.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:26.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:27.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:27.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:27.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:27.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:28.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:28.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:28.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:28.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:29.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:29.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:29.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:29.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:30.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:30.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:30.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:30.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:31.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:31.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:31.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:31.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:32.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:32.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:32.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:32.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:33.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:33.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:33.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:33.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:34.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:34.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:34.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:34.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:35.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:35.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:35.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:35.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:36.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:36.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:36.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:36.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:37.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:37.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:37.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:37.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:38.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:38.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:38.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:38.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:39.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:39.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:39.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:39.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:40.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:40.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:40.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:40.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:41.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:41.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:41.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:41.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:42.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:42.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:42.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:42.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:43.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:43.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:43.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:43.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:44.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:44.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:44.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:44.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:45.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:45.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:45.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:45.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:46.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:46.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:46.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:46.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:47.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:47.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:47.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:47.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:48.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:48.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:48.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:48.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:49.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:49.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:49.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:49.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:50.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:50.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:50.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:50.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:51.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:51.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:51.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:51.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:52.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:52.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:52.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:52.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:53.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:53.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:53.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:53.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:54.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:54.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:54.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:54.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:55.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:55.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:55.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:55.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:56.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:56.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:56.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:56.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:57.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:57.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:57.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:57.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:58.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:58.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:58.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:58.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:59.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:30:59.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:30:59.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:30:59.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:00.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:00.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:00.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:00.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:01.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:01.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:01.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:01.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:02.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:02.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:02.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:02.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:03.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:03.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:03.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:03.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:04.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:04.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:04.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:04.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:05.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:05.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:05.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:05.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:06.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:06.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:06.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:06.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:07.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:07.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:07.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:07.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:08.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:08.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:08.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:08.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:09.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:09.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:09.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:09.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:10.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:10.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:10.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:10.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:11.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:11.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:11.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:11.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:12.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:12.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:12.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:12.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:13.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:13.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:13.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:13.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:14.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:14.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:14.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:14.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:15.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:15.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:15.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:15.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:16.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:16.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:16.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:16.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:17.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:17.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:17.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:17.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:18.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:18.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:18.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:18.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:19.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:19.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:19.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:19.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:20.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:20.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:20.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:20.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:21.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:21.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:21.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:21.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:22.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:22.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:22.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:22.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:23.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:23.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:23.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:23.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:24.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:24.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:24.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:24.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:25.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:25.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:25.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:25.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:26.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:26.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:26.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:26.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:27.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:27.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:27.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:27.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:28.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:28.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:28.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:28.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:29.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:29.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:29.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:29.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:30.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:30.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:30.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:30.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:31.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:31.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:31.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:31.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:32.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:32.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:32.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:32.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:33.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:33.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:33.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:33.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:34.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:34.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:34.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:34.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:35.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:35.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:35.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:35.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:36.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:36.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:36.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:36.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:37.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:37.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:37.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:37.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:38.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:38.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:38.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:38.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:39.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:39.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:39.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:39.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:40.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:40.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:40.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:40.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:41.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:41.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:41.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:41.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:42.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:42.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:42.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:42.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:43.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:43.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:43.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:43.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:44.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:44.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:44.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:44.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:45.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:45.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:45.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:45.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:46.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:46.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:46.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:46.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:47.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:47.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:47.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:47.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:48.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:48.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:48.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:48.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:49.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:49.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:49.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:49.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:50.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:50.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:50.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:50.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:51.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:51.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:51.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:51.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:52.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:52.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:52.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:52.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:53.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:53.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:53.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:53.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:54.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:54.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:54.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:54.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:55.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:55.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:55.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:55.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:56.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:56.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:56.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:56.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:57.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:57.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:57.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:57.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:58.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:58.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:58.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:58.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:59.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:31:59.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:31:59.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:31:59.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:00.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:00.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:00.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:00.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:01.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:01.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:01.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:01.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:02.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:02.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:02.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:02.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:03.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:03.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:03.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:03.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:04.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:04.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:04.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:04.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:05.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:05.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:05.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:05.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:06.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:06.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:06.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:06.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:07.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:07.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:07.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:07.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:08.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:08.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:08.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:08.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:09.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:09.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:09.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:09.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:10.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:10.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:10.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:10.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:11.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:11.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:11.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:11.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:12.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:12.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:12.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:12.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:13.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:13.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:13.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:13.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:14.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:14.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:14.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:14.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:15.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:15.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:15.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:15.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:16.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:16.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:16.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:16.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:17.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:17.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:17.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:17.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:18.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:18.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:18.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:18.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:19.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:19.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:19.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:19.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:20.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:20.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:20.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:20.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:21.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:21.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:21.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:21.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:22.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:22.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:22.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:22.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:23.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:23.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:23.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:23.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:24.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:24.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:24.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:24.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:25.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:25.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:25.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:25.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:26.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:26.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:26.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:26.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:27.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:27.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:27.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:27.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:28.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:28.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:28.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:28.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:29.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:29.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:29.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:29.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:30.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:30.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:30.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:30.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:31.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:31.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:31.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:31.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:32.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:32.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:32.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:32.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:33.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:33.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:33.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:33.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:34.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:34.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:34.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:34.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:35.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:35.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:35.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:35.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:36.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:36.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:36.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:36.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:37.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:37.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:37.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:37.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:38.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:38.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:38.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:38.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:39.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:39.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:39.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:39.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:40.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:40.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:40.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:40.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:41.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:41.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:41.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:41.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:42.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:42.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:42.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:42.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:43.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:43.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:43.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:43.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:44.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:44.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:44.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:44.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:45.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:45.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:45.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:45.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:46.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:46.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:46.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:46.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:47.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:47.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:47.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:47.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:48.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:48.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:48.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:48.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:49.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:49.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:49.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:49.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:50.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:50.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:50.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:50.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:51.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:51.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:51.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:51.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:52.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:52.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:52.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:52.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:53.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:53.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:53.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:53.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:54.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:54.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:54.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:54.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:55.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:55.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:55.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:55.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:56.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:56.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:56.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:56.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:57.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:57.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:57.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:57.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:58.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:58.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:58.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:58.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:59.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:32:59.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:32:59.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:32:59.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:00.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:00.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:00.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:00.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:01.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:01.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:01.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:01.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:02.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:02.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:02.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:02.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:03.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:03.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:03.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:03.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:04.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:04.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:04.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:04.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:05.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:05.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:05.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:05.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:06.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:06.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:06.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:06.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:07.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:07.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:07.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:07.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:08.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:08.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:08.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:08.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:09.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:09.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:09.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:09.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:10.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:10.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:10.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:10.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:11.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:11.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:11.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:11.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:12.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:12.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:12.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:12.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:13.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:13.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:13.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:13.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:14.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:14.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:14.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:14.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:15.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:15.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:15.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:15.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:16.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:16.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:16.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:16.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:17.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:17.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:17.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:17.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:18.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:18.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:18.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:19.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:19.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:19.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:19.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:20.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:20.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:20.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:20.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:21.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:21.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:21.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:21.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:22.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:22.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:22.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:22.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:23.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:23.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:23.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:23.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:24.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:24.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:24.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:24.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:25.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:25.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:25.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:25.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:26.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:26.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:26.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:26.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:27.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:27.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:27.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:27.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:28.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:28.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:28.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:28.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:29.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:29.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:29.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:29.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:30.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:30.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:30.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:30.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:31.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:31.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:31.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:31.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:32.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:32.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:32.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:32.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:33.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:33.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:33.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:33.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:34.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:34.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:34.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:34.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:35.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:35.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:35.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:35.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:36.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:36.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:36.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:36.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:37.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:37.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:37.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:37.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:38.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:38.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:38.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:38.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:39.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:39.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:39.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:39.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:40.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:40.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:40.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:40.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:41.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:41.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:41.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:41.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:42.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:42.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:42.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:42.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:43.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:43.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:43.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:43.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:44.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:44.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:44.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:44.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:45.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:45.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:45.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:45.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:46.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:46.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:46.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:46.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:47.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:47.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:47.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:47.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:48.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:48.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:48.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:48.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:49.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:49.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:49.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:49.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:50.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:50.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:50.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:50.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:51.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:51.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:51.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:51.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:52.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:52.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:52.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:52.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:53.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:53.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:53.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:53.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:54.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:54.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:54.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:54.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:55.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:55.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:55.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:55.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:56.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:56.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:56.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:56.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:57.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:57.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:57.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:57.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:58.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:58.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:58.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:58.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:59.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:33:59.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:33:59.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:33:59.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:00.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:00.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:00.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:00.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:01.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:01.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:01.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:01.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:02.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:02.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:02.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:02.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:03.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:03.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:03.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:03.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:04.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:04.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:04.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:04.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:05.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:05.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:05.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:05.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:06.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:06.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:06.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:06.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:07.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:07.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:07.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:07.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:08.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:08.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:08.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:08.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:09.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:09.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:09.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:09.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:10.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:10.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:10.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:10.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:11.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:11.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:11.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:11.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:12.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:12.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:12.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:12.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:13.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:13.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:13.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:13.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:14.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:14.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:14.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:14.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:15.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:15.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:15.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:15.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:16.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:16.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:16.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:16.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:17.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:17.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:17.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:17.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:18.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:18.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:18.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:18.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:19.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:19.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:19.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:19.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:20.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:20.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:20.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:20.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:21.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:21.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:21.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:21.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:22.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:22.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:22.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:22.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:23.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:23.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:23.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:23.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:24.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:24.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:24.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:24.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:25.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:25.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:25.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:25.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:26.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:26.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:26.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:26.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:27.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:27.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:27.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:27.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:28.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:28.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:28.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:28.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:29.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:29.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:29.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:29.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:30.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:30.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:30.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:30.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:31.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:31.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:31.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:31.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:32.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:32.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:32.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:32.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:33.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:33.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:33.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:33.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:34.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:34.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:34.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:34.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:35.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:35.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:35.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:35.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:36.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:36.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:36.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:36.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:37.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:37.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:37.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:37.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:38.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:38.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:38.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:38.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:39.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:39.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:39.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:39.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:40.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:40.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:40.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:40.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:41.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:41.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:41.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:41.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:42.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:42.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:42.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:42.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:43.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:43.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:43.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:43.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:44.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:44.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:44.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:44.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:45.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:45.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:45.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:45.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:46.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:46.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:46.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:46.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:47.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:47.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:47.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:47.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:48.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:48.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:48.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:48.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:49.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:49.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:49.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:49.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:50.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:50.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:50.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:50.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:51.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:51.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:51.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:51.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:52.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:52.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:52.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:52.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:53.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:53.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:53.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:53.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:54.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:54.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:54.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:54.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:55.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:55.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:55.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:55.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:56.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:56.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:56.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:56.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:57.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:57.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:57.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:57.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:58.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:58.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:58.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:58.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:59.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:34:59.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:34:59.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:34:59.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:00.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:00.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:00.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:00.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:01.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:01.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:02.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:02.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:02.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:02.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:03.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:03.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:03.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:03.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:04.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:04.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:04.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:04.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:05.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:05.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:05.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:05.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:06.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:06.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:06.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:06.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:07.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:07.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:07.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:07.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:08.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:08.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:08.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:08.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:09.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:09.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:09.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:09.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:10.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:10.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:10.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:10.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:11.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:11.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:11.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:11.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:12.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:12.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:12.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:12.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:13.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:13.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:13.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:13.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:14.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:14.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:14.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:14.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:15.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:15.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:15.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:15.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:16.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:16.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:16.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:16.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:17.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:17.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:17.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:17.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:18.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:18.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:18.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:18.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:19.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:19.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:19.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:19.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:20.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:20.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:20.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:20.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:21.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:21.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:21.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:21.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:22.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:22.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:22.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:22.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:23.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:23.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:23.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:23.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:24.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:24.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:24.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:24.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:25.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:25.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:25.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:25.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:26.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:26.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:26.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:26.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:27.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:27.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:27.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:27.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:28.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:28.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:28.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:28.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:29.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:29.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:29.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:29.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:30.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:30.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:30.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:30.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:31.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:31.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:31.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:31.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:32.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:32.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:32.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:32.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:33.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:33.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:33.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:33.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:34.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:34.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:34.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:34.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:35.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:35.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:35.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:35.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:36.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:36.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:36.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:36.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:37.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:37.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:37.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:37.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:38.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:38.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:38.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:38.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:39.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:39.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:39.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:39.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:40.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:40.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:41.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:41.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:41.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:41.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:42.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:42.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:42.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:42.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:43.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:43.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:43.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:43.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:44.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:44.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:44.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:44.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:45.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:45.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:45.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:45.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:46.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:46.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:46.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:46.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:47.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:47.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:47.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:47.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:48.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:48.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:48.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:48.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:49.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:49.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:49.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:49.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:50.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:50.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:50.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:50.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:51.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:51.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:51.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:51.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:52.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:52.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:52.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:52.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:53.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:53.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:53.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:53.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:54.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:54.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:54.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:54.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:55.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:55.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:55.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:55.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:56.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:56.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:56.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:56.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:57.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:57.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:57.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:57.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:58.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:58.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:58.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:58.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:59.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:35:59.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:35:59.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:35:59.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:00.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:00.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:00.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:00.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:01.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:01.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:01.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:01.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:02.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:02.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:02.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:02.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:03.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:03.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:03.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:03.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:04.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:04.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:04.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:04.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:05.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:05.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:05.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:05.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:06.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:06.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:06.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:06.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:07.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:07.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:07.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:07.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:08.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:08.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:08.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:08.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:09.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:09.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:09.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:09.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:10.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:10.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:10.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:10.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:11.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:11.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:11.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:11.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:12.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:12.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:12.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:12.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:13.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:13.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:13.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:13.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:14.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:14.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:14.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:14.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:15.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:15.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:15.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:15.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:16.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:16.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:16.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:16.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:17.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:17.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:17.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:17.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:18.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:18.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:18.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:18.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:19.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:19.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:19.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:19.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:20.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:20.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:20.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:20.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:21.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:21.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:21.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:21.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:22.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:22.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:22.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:22.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:23.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:23.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:23.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:23.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:24.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:24.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:24.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:24.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:25.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:25.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:25.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:25.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:26.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:26.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:26.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:26.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:27.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:27.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:27.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:27.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:28.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:28.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:28.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:28.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:29.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:29.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:29.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:29.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:30.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:30.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:30.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:30.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:31.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:31.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:31.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:31.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:32.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:32.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:32.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:32.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:33.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:33.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:33.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:33.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:34.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:34.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:34.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:34.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:35.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:35.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:35.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:35.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:36.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:36.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:36.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:36.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:37.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:37.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:37.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:37.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:38.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:38.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:38.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:38.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:39.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:39.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:39.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:39.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:40.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:40.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:40.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:40.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:41.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:41.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:41.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:41.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:42.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:42.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:42.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:42.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:43.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:43.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:43.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:43.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:44.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:44.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:44.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:44.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:45.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:45.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:45.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:45.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:46.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:46.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:46.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:46.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:47.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:47.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:47.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:47.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:48.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:48.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:48.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:48.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:49.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:49.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:49.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:49.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:50.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:50.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:50.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:50.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:51.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:51.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:51.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:51.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:52.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:52.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:52.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:52.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:53.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:53.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:53.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:53.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:54.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:54.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:54.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:54.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:55.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:55.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:55.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:55.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:56.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:56.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:56.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:56.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:57.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:57.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:57.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:57.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:58.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:58.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:58.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:58.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:59.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:36:59.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:36:59.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:36:59.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:00.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:00.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:00.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:00.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:01.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:01.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:01.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:01.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:02.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:02.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:02.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:02.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:03.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:03.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:03.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:03.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:04.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:04.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:04.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:04.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:05.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:05.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:05.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:05.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:06.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:06.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:06.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:07.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:07.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:07.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:07.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:08.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:08.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:08.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:08.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:09.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:09.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:09.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:09.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:10.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:10.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:10.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:10.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:11.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:11.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:11.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:11.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:12.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:12.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:12.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:12.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:13.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:13.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:13.552 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T00:37:13.549+0000 7f5fc4669700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6808/29215,v1:172.21.15.163:6809/29215] conn(0x7f5fa403c310 msgr2=0x7f5fa40df1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T00:37:13.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:13.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:14.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:14.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:14.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:14.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:15.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:15.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:15.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:15.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:16.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:16.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:16.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:16.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:17.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:17.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:17.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:17.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:18.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:18.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:18.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:18.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:19.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:19.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:19.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:19.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:20.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:20.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:20.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:20.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:21.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:21.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:21.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:21.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:22.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:22.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:22.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:22.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:23.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:23.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:23.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:23.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:24.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:24.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:24.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:24.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:25.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:25.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:25.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:25.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:26.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:26.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:26.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:26.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:27.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:27.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:28.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:28.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:28.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:28.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:29.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:29.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:29.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:29.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:30.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:30.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:30.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:30.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:31.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:31.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:31.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:31.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:32.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:32.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:32.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:32.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:32.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:32.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:33.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:33.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:33.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:33.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:34.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:34.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:35.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:35.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:35.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:35.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:35.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:35.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:36.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:36.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:36.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:36.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:37.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:37.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:37.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:37.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:38.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:38.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:38.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:38.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:39.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:39.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:39.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:39.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:40.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:40.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:40.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:40.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:41.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:41.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:41.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:41.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:42.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:42.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:42.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:42.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:43.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:43.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:43.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:43.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:44.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:44.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:44.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:44.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:45.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:45.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:45.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:45.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:46.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:46.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:46.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:46.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:47.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:47.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:47.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:47.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:48.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:48.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:48.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:48.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:49.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:49.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:49.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:49.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:50.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:50.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:50.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:50.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:51.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:51.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:51.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:51.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:52.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:52.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:52.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:52.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:53.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:53.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:53.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:53.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:54.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:54.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:54.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:54.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:55.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:55.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:55.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:55.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:56.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:56.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:56.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:56.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:57.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:57.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:57.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:57.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:58.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:58.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:58.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:58.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:59.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:37:59.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:37:59.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:37:59.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:00.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:00.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:00.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:00.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:01.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:01.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:01.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:01.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:02.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:02.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:02.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:02.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:03.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:03.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:03.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:03.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:04.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:04.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:04.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:04.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:05.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:05.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:05.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:05.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:06.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:06.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:06.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:06.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:07.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:07.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:07.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:07.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:08.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:08.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:08.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:08.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:09.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:09.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:09.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:09.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:10.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:10.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:10.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:10.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:11.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:11.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:11.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:11.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:12.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:12.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:12.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:12.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:13.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:13.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:13.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:13.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:14.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:14.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:14.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:14.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:15.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:15.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:15.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:15.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:16.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:16.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:16.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:16.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:17.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:17.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:17.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:17.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:18.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:18.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:18.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:18.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:19.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:19.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:19.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:19.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:20.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:20.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:20.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:20.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:21.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:21.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:21.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:21.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:22.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:22.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:22.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:22.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:23.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:23.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:23.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:23.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:24.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:24.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:24.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:24.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:25.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:25.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:25.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:25.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:26.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:26.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:26.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:26.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:27.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:27.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:27.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:27.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:28.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:28.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:28.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:28.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:29.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:29.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:30.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:30.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:30.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:30.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:31.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:31.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:32.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:31.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:32.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:32.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:33.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:33.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:33.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:33.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:34.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:34.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:34.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:34.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:34.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:34.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:34.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:34.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:35.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:35.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:35.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:35.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:36.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:36.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:37.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:36.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:37.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:37.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:38.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:38.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:38.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:38.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:39.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:39.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:39.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:39.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:40.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:40.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:40.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:40.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:41.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:41.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:41.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:41.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:42.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:42.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:42.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:42.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:42.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:42.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:43.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:43.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:43.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:43.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:44.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:44.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:44.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:44.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:45.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:45.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:45.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:45.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:46.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:46.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:46.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:46.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:47.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:47.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:48.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:48.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:48.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:48.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:49.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:49.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:49.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:49.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:49.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:49.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:50.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:50.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:50.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:50.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:51.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:51.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:51.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:51.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:52.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:52.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:52.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:52.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:53.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:53.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:53.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:53.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:54.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:54.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:54.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:54.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:55.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:55.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:55.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:55.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:56.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:56.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:56.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:56.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:57.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:57.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:57.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:57.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:58.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:58.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:58.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:58.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:59.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:38:59.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:38:59.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:38:59.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:00.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:00.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:00.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:00.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:01.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:01.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:01.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:01.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:02.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:02.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:02.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:02.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:03.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:03.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:03.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:03.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:04.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:04.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:04.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:04.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:05.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:05.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:05.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:05.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:06.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:06.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:06.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:06.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:07.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:07.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:08.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:08.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:08.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:08.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:09.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:09.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:09.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:09.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:10.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:10.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:10.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:10.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:11.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:11.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:11.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:11.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:12.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:12.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:13.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:13.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:13.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:13.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:14.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:14.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:14.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:14.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:15.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:15.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:15.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:15.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:16.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:16.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:16.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:16.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:17.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:17.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:17.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:17.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:18.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:18.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:18.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:18.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:19.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:19.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:19.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:19.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:20.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:20.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:20.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:20.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:21.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:21.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:21.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:21.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:22.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:22.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:22.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:22.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:23.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:23.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:23.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:23.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:23.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:23.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:24.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:24.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:24.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:24.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:25.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:25.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:25.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:25.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:26.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:26.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:26.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:26.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:27.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:27.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:27.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:27.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:28.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:28.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:28.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:28.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:29.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:29.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:29.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:29.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:30.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:30.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:30.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:30.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:31.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:31.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:31.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:31.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:32.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:32.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:32.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:32.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:33.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:33.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:33.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:33.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:34.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:34.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:34.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:34.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:35.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:35.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:35.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:35.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:36.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:36.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:36.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:36.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:37.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:37.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:37.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:37.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:38.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:38.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:39.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:39.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:39.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:39.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:40.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:40.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:40.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:40.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:41.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:41.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:41.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:41.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:42.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:42.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:42.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:42.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:43.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:43.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:43.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:43.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:44.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:44.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:44.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:44.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:44.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:44.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:45.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:45.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:45.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:45.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:46.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:46.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:46.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:46.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:47.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:47.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:47.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:47.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:48.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:48.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:48.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:48.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:49.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:49.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:49.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:49.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:50.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:50.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:50.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:50.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:51.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:51.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:51.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:51.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:52.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:52.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:52.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:52.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:53.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:53.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:53.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:53.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:54.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:54.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:54.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:54.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:55.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:55.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:55.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:55.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:56.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:56.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:56.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:56.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:57.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:57.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:57.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:57.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:58.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:58.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:58.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:58.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:59.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:59.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:59.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:39:59.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:39:59.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:39:59.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:00.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:00.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:01.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:01.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:01.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:01.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:02.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:02.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:02.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:02.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:03.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:02.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:03.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:03.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:03.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:03.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:04.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:04.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:05.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:05.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:05.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:05.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:05.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:05.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:06.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:06.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:07.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:07.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:07.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:07.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:08.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:08.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:08.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:08.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:09.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:09.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:09.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:09.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:10.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:10.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:10.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:10.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:11.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:11.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:11.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:11.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:12.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:12.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:12.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:12.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:13.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:13.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:13.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:13.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:14.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:14.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:14.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:14.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:15.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:15.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:15.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:15.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:16.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:16.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:16.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:16.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:17.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:17.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:17.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:17.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:18.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:18.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:18.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:18.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:19.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:19.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:19.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:19.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:20.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:20.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:20.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:20.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:21.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:21.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:21.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:21.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:22.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:22.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:22.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:22.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:23.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:23.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:23.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:23.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:24.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:24.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:24.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:24.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:25.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:25.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:25.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:25.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:26.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:26.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:26.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:26.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:27.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:27.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:27.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:27.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:28.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:28.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:28.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:28.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:29.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:29.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:29.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:29.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:30.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:30.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:30.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:30.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:31.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:31.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:31.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:31.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:32.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:32.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:32.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:32.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:33.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:33.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:33.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:33.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:34.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:34.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:34.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:34.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:35.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:35.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:35.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:35.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:36.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:36.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:36.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:36.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:37.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:37.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:37.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:37.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:38.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:38.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:38.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:38.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:39.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:39.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:39.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:39.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:40.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:40.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:40.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:40.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:41.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:41.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:41.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:41.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:42.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:42.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:42.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:42.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:43.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:43.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:43.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:43.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:44.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:44.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:44.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:44.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:45.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:45.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:45.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:45.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:46.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:46.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:46.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:46.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:47.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:47.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:47.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:47.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:48.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:48.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:49.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:49.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:49.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:49.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:49.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:49.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:50.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:50.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:50.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:50.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:51.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:51.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:51.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:51.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:52.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:52.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:53.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:53.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:53.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:53.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:54.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:54.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:54.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:54.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:55.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:55.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:55.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:55.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:56.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:56.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:56.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:56.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:57.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:57.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:57.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:57.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:58.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:58.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:58.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:58.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:59.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:40:59.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:40:59.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:40:59.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:00.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:00.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:00.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:00.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:01.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:01.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:01.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:01.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:02.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:02.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:02.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:02.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:03.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:03.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:03.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:03.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:04.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:04.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:04.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:04.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:05.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:05.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:05.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:05.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:06.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:06.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:06.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:06.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:07.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:07.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:07.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:07.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:08.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:08.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:08.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:08.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:09.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:09.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:09.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:09.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:10.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:10.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:10.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:10.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:11.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:11.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:11.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:11.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:12.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:12.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:12.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:12.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:13.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:13.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:13.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:13.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:14.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:14.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:14.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:14.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:15.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:15.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:15.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:15.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:16.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:16.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:16.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:16.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:17.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:17.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:17.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:17.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:18.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:18.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:18.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:18.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:19.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:19.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:19.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:19.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:20.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:20.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:20.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:20.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:21.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:21.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:21.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:21.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:22.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:22.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:22.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:22.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:23.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:23.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:23.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:23.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:24.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:24.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:24.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:24.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:25.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:25.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:25.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:25.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:26.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:26.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:26.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:26.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:27.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:27.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:27.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:27.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:28.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:28.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:28.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:28.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:28.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:28.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:29.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:29.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:30.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:30.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:30.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:30.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:31.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:31.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:31.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:31.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:32.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:32.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:32.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:32.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:33.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:33.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:33.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:33.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:34.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:34.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:34.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:34.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:35.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:35.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:35.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:35.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:36.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:36.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:36.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:36.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:37.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:37.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:37.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:37.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:38.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:38.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:38.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:38.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:39.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:39.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:39.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:39.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:40.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:40.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:40.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:40.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:41.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:41.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:41.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:41.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:42.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:42.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:42.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:42.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:43.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:43.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:43.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:43.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:44.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:44.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:44.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:44.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:45.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:45.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:45.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:45.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:45.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:45.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:46.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:46.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:46.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:46.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:47.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:47.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:47.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:47.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:48.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:48.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:49.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:48.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:49.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:49.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:49.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:49.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:50.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:50.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:51.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:51.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:51.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:51.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:52.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:52.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:52.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:52.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:53.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:53.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:53.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:53.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:53.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:53.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:54.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:54.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:54.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:54.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:55.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:55.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:55.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:55.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:56.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:56.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:56.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:56.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:57.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:57.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:57.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:57.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:58.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:58.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:58.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:58.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:59.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:41:59.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:41:59.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:41:59.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:00.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:00.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:00.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:00.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:01.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:01.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:01.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:01.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:02.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:02.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:02.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:02.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:03.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:03.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:03.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:03.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:04.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:04.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:04.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:04.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:05.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:05.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:05.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:05.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:06.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:06.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:06.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:06.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:07.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:07.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:07.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:07.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:08.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:08.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:08.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:08.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:09.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:09.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:09.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:09.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:10.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:10.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:10.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:10.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:11.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:11.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:11.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:11.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:12.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:12.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:12.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:12.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:13.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:13.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:13.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:13.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:14.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:14.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:14.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:14.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:15.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:15.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:15.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:15.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:16.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:16.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:16.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:16.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:17.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:17.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:17.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:17.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:18.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:18.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:18.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:18.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:19.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:19.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:19.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:19.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:20.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:20.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:20.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:20.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:21.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:21.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:21.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:21.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:22.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:22.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:22.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:22.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:23.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:23.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:23.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:23.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:24.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:24.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:24.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:24.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:25.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:25.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:25.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:25.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:26.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:26.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:26.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:26.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:27.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:27.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:27.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:27.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:28.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:28.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:28.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:28.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:29.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:29.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:29.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:29.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:30.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:30.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:30.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:30.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:31.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:31.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:31.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:31.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:32.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:32.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:32.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:32.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:33.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:33.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:33.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:33.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:34.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:34.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:34.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:34.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:35.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:35.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:35.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:35.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:36.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:36.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:36.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:36.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:37.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:37.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:37.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:37.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:38.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:38.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:38.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:38.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:39.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:39.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:39.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:39.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:40.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:40.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:40.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:40.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:41.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:41.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:41.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:41.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:42.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:42.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:42.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:42.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:43.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:43.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:43.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:43.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:44.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:44.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:44.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:44.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:45.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:45.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:45.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:45.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:46.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:46.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:46.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:46.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:47.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:47.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:47.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:47.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:48.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:48.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:48.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:48.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:49.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:49.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:49.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:49.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:50.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:50.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:50.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:50.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:51.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:51.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:51.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:51.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:52.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:52.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:52.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:52.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:53.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:53.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:53.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:53.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:54.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:54.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:54.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:54.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:55.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:55.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:55.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:55.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:56.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:56.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:56.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:56.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:57.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:57.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:57.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:57.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:58.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:58.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:58.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:58.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:59.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:42:59.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:42:59.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:42:59.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:00.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:00.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:00.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:00.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:01.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:01.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:01.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:01.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:02.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:02.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:02.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:02.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:03.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:03.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:03.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:03.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:04.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:04.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:04.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:04.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:05.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:05.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:05.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:05.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:06.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:06.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:06.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:06.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:07.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:07.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:07.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:07.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:08.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:08.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:08.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:08.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:09.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:09.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:09.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:09.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:10.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:10.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:10.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:10.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:11.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:11.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:11.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:11.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:12.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:12.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:12.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:12.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:13.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:13.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:13.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:13.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:14.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:14.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:14.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:14.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:15.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:15.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:15.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:15.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:16.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:16.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:16.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:16.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:17.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:17.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:17.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:17.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:18.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:18.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:18.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:18.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:19.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:19.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:19.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:19.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:20.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:20.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:20.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:20.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:21.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:21.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:21.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:21.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:22.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:22.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:22.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:22.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:23.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:23.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:23.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:23.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:24.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:24.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:24.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:24.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:25.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:25.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:25.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:25.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:26.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:26.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:26.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:26.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:27.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:27.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:27.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:27.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:28.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:28.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:28.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:28.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:29.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:29.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:29.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:29.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:30.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:30.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:30.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:30.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:31.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:31.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:31.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:31.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:32.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:32.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:32.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:32.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:33.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:33.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:33.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:33.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:34.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:34.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:34.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:34.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:35.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:35.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:35.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:35.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:36.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:36.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:36.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:36.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:37.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:37.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:37.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:37.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:38.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:38.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:38.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:38.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:39.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:39.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:39.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:39.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:40.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:40.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:40.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:40.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:41.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:41.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:41.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:41.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:42.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:42.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:42.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:42.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:43.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:43.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:43.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:43.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:44.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:44.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:44.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:44.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:45.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:45.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:45.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:45.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:46.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:46.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:46.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:46.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:47.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:47.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:47.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:47.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:48.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:48.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:48.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:48.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:49.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:49.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:49.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:49.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:50.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:50.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:50.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:50.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:51.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:51.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:51.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:51.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:52.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:52.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:52.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:52.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:53.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:53.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:53.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:53.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:54.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:54.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:54.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:54.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:55.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:55.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:55.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:55.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:56.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:56.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:56.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:56.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:57.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:57.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:57.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:57.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:58.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:58.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:58.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:58.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:59.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:43:59.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:43:59.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:43:59.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:00.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:00.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:00.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:00.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:01.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:01.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:01.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:01.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:02.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:02.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:02.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:02.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:03.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:03.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:03.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:03.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:04.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:04.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:04.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:04.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:05.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:05.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:05.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:05.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:06.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:06.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:06.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:06.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:07.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:07.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:07.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:07.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:08.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:08.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:08.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:08.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:09.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:09.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:09.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:09.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:10.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:10.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:10.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:10.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:11.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:11.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:11.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:11.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:12.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:12.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:12.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:12.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:13.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:13.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:13.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:13.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:14.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:14.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:14.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:14.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:15.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:15.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:15.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:15.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:16.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:16.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:16.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:16.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:17.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:17.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:17.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:17.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:18.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:18.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:18.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:18.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:19.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:19.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:19.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:19.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:20.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:20.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:20.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:20.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:21.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:21.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:21.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:21.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:22.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:22.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:22.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:22.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:23.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:23.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:23.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:23.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:24.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:24.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:24.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:24.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:25.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:25.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:25.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:25.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:26.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:26.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:26.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:26.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:27.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:27.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:27.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:27.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:28.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:28.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:28.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:28.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:29.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:29.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:29.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:29.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:30.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:30.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:30.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:30.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:31.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:31.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:31.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:31.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:32.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:32.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:32.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:32.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:33.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:33.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:33.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:33.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:34.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:34.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:34.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:34.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:35.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:35.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:35.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:35.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:36.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:36.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:36.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:36.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:37.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:37.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:37.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:37.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:38.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:38.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:38.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:38.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:39.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:39.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:39.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:39.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:40.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:40.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:40.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:40.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:41.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:41.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:41.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:41.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:42.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:42.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:42.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:42.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:43.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:43.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:43.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:43.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:44.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:44.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:45.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:45.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:45.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:45.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:46.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:46.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:46.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:46.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:47.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:47.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:47.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:47.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:47.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:48.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:48.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:48.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:48.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:49.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:49.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:50.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:50.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:50.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:51.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:50.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:51.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:51.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:52.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:52.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:52.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:52.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:53.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:53.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:53.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:53.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:54.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:54.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:54.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:54.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:55.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:55.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:55.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:55.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:56.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:56.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:56.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:56.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:57.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:57.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:57.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:57.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:58.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:58.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:58.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:58.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:59.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:44:59.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:44:59.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:44:59.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:00.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:00.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:00.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:00.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:01.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:01.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:01.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:01.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:02.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:02.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:02.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:02.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:03.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:03.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:03.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:03.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:04.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:04.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:04.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:04.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:05.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:05.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:05.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:05.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:06.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:06.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:06.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:06.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:07.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:07.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:07.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:07.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:08.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:08.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:08.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:08.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:09.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:09.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:09.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:09.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:10.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:10.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:10.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:10.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:11.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:11.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:11.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:11.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:12.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:12.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:12.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:12.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:13.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:13.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:13.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:13.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:14.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:14.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:14.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:14.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:15.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:15.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:15.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:15.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:16.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:16.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:16.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:16.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:17.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:17.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:17.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:17.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:18.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:18.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:18.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:18.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:19.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:19.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:19.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:19.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:20.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:20.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:20.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:20.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:21.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:21.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:21.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:21.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:22.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:22.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:22.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:22.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:23.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:23.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:23.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:23.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:24.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:24.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:24.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:24.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:25.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:25.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:25.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:25.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:26.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:26.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:26.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:26.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:27.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:27.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:28.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:28.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:28.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:28.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:29.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:29.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:29.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:29.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:30.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:30.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:30.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:30.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:31.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:31.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:31.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:31.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:32.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:32.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:32.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:32.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:33.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:33.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:33.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:33.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:34.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:34.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:34.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:34.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:35.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:35.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:35.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:35.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:36.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:36.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:36.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:36.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:37.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:37.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:37.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:37.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:38.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:38.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:38.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:38.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:39.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:39.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:39.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:39.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:40.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:40.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:40.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:40.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:41.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:41.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:41.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:41.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:42.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:42.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:42.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:42.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:43.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:43.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:43.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:43.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:44.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:44.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:44.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:44.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:45.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:45.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:45.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:45.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:46.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:46.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:46.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:46.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:47.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:47.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:47.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:47.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:48.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:48.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:48.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:48.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:49.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:49.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:49.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:49.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:50.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:50.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:50.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:50.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:51.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:51.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:51.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:51.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:52.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:52.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:52.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:52.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:53.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:53.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:53.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:53.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:54.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:54.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:54.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:54.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:55.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:55.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:55.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:55.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:56.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:56.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:56.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:56.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:57.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:57.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:57.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:57.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:58.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:58.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:58.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:58.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:59.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:45:59.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:45:59.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:45:59.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:00.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:00.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:00.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:00.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:01.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:01.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:01.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:01.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:02.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:02.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:02.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:02.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:03.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:03.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:03.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:03.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:04.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:04.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:04.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:04.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:05.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:05.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:05.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:05.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:06.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:06.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:06.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:06.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:07.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:07.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:07.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:07.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:08.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:08.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:08.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:08.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:09.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:09.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:09.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:09.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:10.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:10.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:10.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:10.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:11.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:11.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:11.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:11.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:12.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:12.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:12.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:12.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:13.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:13.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:13.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:13.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:14.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:14.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:14.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:14.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:15.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:15.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:15.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:15.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:16.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:16.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:16.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:16.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:17.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:17.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:17.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:17.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:18.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:18.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:18.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:18.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:19.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:19.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:19.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:19.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:20.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:20.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:20.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:20.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:21.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:21.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:21.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:21.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:22.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:22.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:22.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:22.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:23.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:23.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:23.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:23.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:24.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:24.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:24.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:24.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:25.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:25.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:25.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:25.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:26.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:26.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:26.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:26.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:27.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:27.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:27.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:27.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:28.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:28.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:28.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:28.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:29.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:29.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:29.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:29.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:30.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:30.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:30.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:30.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:31.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:31.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:31.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:31.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:32.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:32.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:32.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:32.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:33.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:33.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:33.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:33.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:34.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:34.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:34.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:34.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:35.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:35.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:35.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:35.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:36.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:36.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:36.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:36.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:37.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:37.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:37.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:37.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:38.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:38.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:38.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:38.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:39.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:39.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:39.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:39.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:40.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:40.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:40.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:40.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:41.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:41.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:41.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:41.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:42.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:42.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:42.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:42.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:43.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:43.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:43.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:43.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:44.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:44.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:44.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:44.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:45.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:45.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:45.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:45.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:46.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:46.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:46.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:46.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:47.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:47.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:47.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:47.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:48.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:48.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:48.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:48.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:49.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:49.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:49.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:49.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:50.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:50.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:50.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:50.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:51.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:51.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:51.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:51.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:52.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:52.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:52.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:52.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:53.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:53.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:53.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:53.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:54.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:54.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:54.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:54.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:55.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:55.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:55.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:55.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:56.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:56.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:56.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:56.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:57.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:57.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:57.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:57.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:58.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:58.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:58.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:58.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:59.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:46:59.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:46:59.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:46:59.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:00.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:00.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:00.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:00.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:01.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:01.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:01.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:01.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:02.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:02.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:02.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:02.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:03.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:03.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:03.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:03.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:04.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:04.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:04.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:04.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:05.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:05.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:05.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:05.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:06.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:06.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:06.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:06.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:07.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:07.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:07.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:07.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:08.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:08.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:08.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:08.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:09.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:09.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:09.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:09.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:10.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:10.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:10.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:10.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:11.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:11.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:11.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:11.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:12.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:12.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:12.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:12.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:13.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:13.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:13.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:13.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:14.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:14.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:14.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:14.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:15.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:15.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:15.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:15.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:16.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:16.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:16.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:16.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:16.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:16.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:17.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:17.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:18.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:18.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:18.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:18.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:19.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:19.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:19.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:19.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:20.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:20.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:20.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:20.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:21.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:21.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:21.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:21.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:22.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:22.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:22.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:22.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:23.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:23.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:23.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:23.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:24.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:24.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:24.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:24.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:25.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:25.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:25.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:25.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:26.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:26.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:26.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:26.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:27.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:27.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:27.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:27.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:28.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:28.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:28.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:28.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:29.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:29.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:29.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:29.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:30.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:30.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:30.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:30.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:31.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:31.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:31.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:31.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:32.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:32.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:32.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:32.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:33.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:33.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:33.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:33.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:34.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:34.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:34.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:34.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:35.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:35.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:35.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:35.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:36.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:36.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:36.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:36.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:37.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:37.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:37.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:37.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:38.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:38.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:38.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:38.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:39.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:39.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:39.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:39.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:40.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:40.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:40.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:40.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:40.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:40.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:41.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:41.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:41.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:41.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:42.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:42.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:42.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:42.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:43.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:43.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:43.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:43.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:44.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:44.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:44.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:44.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:45.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:45.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:45.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:45.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:46.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:46.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:46.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:46.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:47.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:47.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:47.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:47.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:48.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:48.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:48.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:48.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:49.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:49.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:49.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:49.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:50.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:50.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:50.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:51.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:51.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:51.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:51.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:52.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:52.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:52.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:52.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:52.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:52.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:53.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:53.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:54.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:53.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:54.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:54.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:55.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:55.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:55.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:55.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:56.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:56.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:56.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:56.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:57.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:57.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:57.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:57.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:58.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:58.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:58.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:58.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:58.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:47:58.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:47:59.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:47:59.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:00.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:00.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:00.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:00.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:01.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:00.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:01.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:01.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:01.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:01.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:02.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:02.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:02.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:02.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:03.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:03.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:04.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:04.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:04.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:04.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:05.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:05.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:05.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:05.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:06.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:06.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:06.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:06.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:07.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:07.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:07.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:07.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:08.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:08.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:08.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:08.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:09.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:09.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:09.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:09.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:10.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:10.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:10.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:10.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:11.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:11.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:11.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:11.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:12.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:12.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:12.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:12.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:13.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:13.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:13.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:13.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:14.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:14.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:14.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:14.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:15.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:15.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:15.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:15.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:16.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:16.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:16.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:16.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:17.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:17.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:17.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:17.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:18.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:18.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:18.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:18.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:19.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:19.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:19.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:19.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:20.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:20.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:20.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:20.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:21.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:21.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:21.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:21.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:22.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:22.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:23.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:23.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:23.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:23.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:24.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:24.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:24.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:25.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:25.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:25.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:25.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:26.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:26.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:26.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:26.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:27.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:27.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:27.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:27.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:28.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:28.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:28.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:28.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:29.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:29.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:29.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:29.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:30.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:30.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:30.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:30.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:31.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:31.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:31.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:31.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:32.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:32.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:32.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:32.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:33.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:33.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:33.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:33.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:34.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:34.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:34.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:34.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:35.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:35.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:35.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:35.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:36.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:36.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:36.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:36.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:37.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:37.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:37.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:37.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:37.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:37.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:38.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:38.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:38.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:38.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:39.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:39.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:40.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:40.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:40.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:40.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:41.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:41.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:41.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:41.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:42.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:42.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:42.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:42.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:43.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:43.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:43.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:43.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:44.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:44.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:44.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:44.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:45.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:45.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:45.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:45.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:46.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:46.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:46.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:46.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:47.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:47.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:47.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:47.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:48.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:48.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:48.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:48.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:49.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:49.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:49.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:49.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:50.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:50.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:50.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:50.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:51.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:51.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:51.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:51.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:52.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:52.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:52.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:52.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:53.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:53.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:53.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:53.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:54.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:54.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:54.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:54.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:55.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:55.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:55.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:55.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:56.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:56.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:56.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:56.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:57.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:57.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:57.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:57.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:58.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:58.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:58.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:58.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:59.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:48:59.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:48:59.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:48:59.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:00.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:00.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:00.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:00.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:01.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:01.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:01.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:01.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:02.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:02.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:02.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:02.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:03.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:03.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:03.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:03.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:04.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:04.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:04.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:04.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:05.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:05.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:05.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:05.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:06.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:06.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:06.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:06.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:07.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:07.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:07.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:07.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:08.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:08.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:08.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:08.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:09.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:09.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:09.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:09.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:10.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:10.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:10.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:10.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:11.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:11.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:11.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:11.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:12.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:12.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:12.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:12.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:13.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:13.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:13.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:13.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:14.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:14.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:14.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:14.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:15.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:15.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:15.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:15.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:16.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:16.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:16.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:16.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:17.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:17.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:17.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:17.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:18.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:18.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:18.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:18.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:19.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:19.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:19.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:19.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:20.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:20.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:20.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:20.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:21.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:21.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:21.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:21.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:22.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:22.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:22.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:22.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:23.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:23.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:23.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:23.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:24.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:24.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:24.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:24.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:25.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:25.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:25.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:25.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:26.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:26.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:26.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:26.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:27.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:27.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:27.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:27.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:28.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:28.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:28.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:28.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:29.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:29.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:29.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:29.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:30.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:30.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:30.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:30.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:31.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:31.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:31.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:31.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:32.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:32.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:32.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:32.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:33.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:32.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:33.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:33.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:34.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:34.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:34.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:34.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:35.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:35.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:35.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:35.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:36.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:36.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:36.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:36.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:37.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:37.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:37.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:37.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:38.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:38.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:38.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:38.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:39.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:39.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:39.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:39.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:40.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:40.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:40.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:40.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:41.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:41.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:41.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:41.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:42.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:42.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:42.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:42.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:43.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:43.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:43.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:43.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:44.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:44.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:44.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:44.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:45.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:45.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:45.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:45.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:46.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:46.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:46.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:46.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:47.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:47.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:47.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:47.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:48.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:48.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:48.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:48.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:49.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:49.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:49.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:49.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:50.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:50.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:50.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:50.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:51.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:51.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:51.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:51.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:52.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:52.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:52.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:52.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:53.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:53.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:53.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:53.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:53.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:53.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:54.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:54.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:55.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:55.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:55.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:55.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:55.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:55.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:56.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:56.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:57.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:57.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:57.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:57.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:58.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:58.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:58.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:58.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:58.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:58.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:59.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:49:59.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:49:59.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:49:59.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:00.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:00.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:00.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:00.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:01.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:01.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:01.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:01.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:02.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:02.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:02.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:02.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:03.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:03.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:03.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:03.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:04.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:04.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:04.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:04.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:05.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:05.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:05.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:05.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:06.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:06.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:06.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:06.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:07.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:07.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:07.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:07.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:08.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:08.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:08.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:08.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:09.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:09.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:09.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:09.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:10.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:10.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:10.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:10.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:11.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:11.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:11.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:11.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:12.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:12.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:12.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:12.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:13.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:13.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:13.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:13.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:14.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:14.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:14.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:14.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:15.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:15.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:15.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:15.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:16.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:16.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:16.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:16.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:17.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:17.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:17.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:17.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:18.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:18.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:18.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:18.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:19.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:19.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:19.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:19.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:20.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:20.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:20.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:20.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:21.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:21.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:21.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:21.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:22.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:22.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:22.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:22.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:23.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:23.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:23.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:23.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:24.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:24.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:24.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:24.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:25.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:25.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:25.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:25.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:26.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:26.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:26.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:26.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:27.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:27.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:27.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:27.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:28.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:28.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:28.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:28.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:29.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:29.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:29.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:29.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:30.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:30.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:30.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:30.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:31.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:31.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:31.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:31.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:32.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:32.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:32.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:32.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:33.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:33.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:33.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:33.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:34.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:34.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:34.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:34.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:35.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:35.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:35.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:35.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:36.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:36.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:36.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:36.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:37.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:37.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:37.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:37.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:38.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:38.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:38.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:38.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:39.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:39.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:39.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:39.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:40.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:40.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:40.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:40.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:41.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:41.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:42.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:42.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:42.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:42.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:43.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:43.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:43.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:43.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:43.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:43.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:44.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:44.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:45.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:45.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:45.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:45.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:46.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:46.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:46.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:46.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:47.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:47.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:47.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:47.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:48.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:48.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:48.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:48.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:49.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:49.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:49.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:49.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:50.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:50.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:50.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:50.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:51.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:51.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:51.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:51.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:52.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:52.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:52.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:52.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:53.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:53.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:53.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:53.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:54.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:54.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:54.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:54.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:55.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:55.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:55.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:55.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:56.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:56.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:56.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:56.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:57.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:57.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:57.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:57.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:58.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:58.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:58.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:58.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:59.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:50:59.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:50:59.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:50:59.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:00.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:00.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:00.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:00.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:01.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:01.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:01.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:01.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:02.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:02.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:02.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:02.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:03.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:03.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:03.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:03.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:04.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:04.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:04.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:04.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:05.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:05.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:05.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:05.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:06.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:06.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:06.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:06.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:07.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:07.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:07.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:07.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:08.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:08.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:08.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:08.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:09.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:09.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:09.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:09.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:10.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:10.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:10.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:10.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:11.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:11.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:11.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:11.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:12.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:12.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:12.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:12.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:13.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:13.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:13.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:13.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:14.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:14.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:14.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:14.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:15.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:15.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:15.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:15.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:16.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:16.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:16.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:16.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:17.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:17.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:17.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:17.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:18.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:18.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:18.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:18.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:19.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:19.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:19.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:19.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:20.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:20.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:20.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:20.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:21.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:21.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:21.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:21.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:22.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:22.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:22.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:22.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:23.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:23.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:23.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:23.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:24.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:24.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:24.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:24.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:25.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:25.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:25.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:25.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:26.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:26.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:26.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:26.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:27.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:27.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:27.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:27.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:28.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:28.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:28.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:28.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:29.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:29.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:29.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:29.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:30.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:30.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:30.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:30.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:31.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:31.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:31.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:31.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:32.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:32.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:32.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:32.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:33.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:33.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:33.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:33.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:34.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:34.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:34.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:34.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:35.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:35.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:35.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:35.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:36.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:36.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:36.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:36.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:37.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:37.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:37.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:37.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:38.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:38.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:38.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:38.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:39.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:39.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:39.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:39.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:40.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:40.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:40.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:40.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:41.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:41.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:41.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:41.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:42.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:42.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:42.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:42.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:43.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:43.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:43.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:43.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:44.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:44.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:44.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:44.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:45.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:45.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:45.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:45.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:46.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:46.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:46.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:46.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:47.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:47.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:47.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:47.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:48.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:48.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:48.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:48.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:49.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:49.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:49.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:49.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:50.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:50.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:50.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:50.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:51.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:51.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:51.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:51.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:52.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:52.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:52.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:52.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:53.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:53.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:53.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:53.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:54.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:54.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:54.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:54.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:55.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:55.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:55.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:55.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:56.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:56.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:56.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:56.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:57.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:57.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:57.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:57.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:58.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:58.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:58.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:58.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:59.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:51:59.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:51:59.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:51:59.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:00.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:00.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:00.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:00.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:01.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:01.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:01.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:01.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:02.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:02.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:02.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:02.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:03.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:03.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:03.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:03.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:04.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:04.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:04.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:04.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:05.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:05.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:05.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:05.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:06.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:06.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:06.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:06.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:07.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:07.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:07.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:07.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:08.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:08.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:08.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:08.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:09.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:09.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:09.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:09.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:10.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:10.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:10.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:10.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:11.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:11.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:11.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:11.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:12.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:12.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:12.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:12.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:13.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:13.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:13.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:13.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:14.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:14.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:14.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:14.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:15.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:15.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:15.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:15.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:16.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:16.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:16.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:16.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:17.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:17.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:17.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:17.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:18.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:18.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:18.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:18.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:19.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:19.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:19.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:19.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:20.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:20.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:20.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:20.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:21.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:21.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:21.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:21.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:22.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:22.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:22.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:22.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:23.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:23.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:23.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:23.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:24.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:24.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:24.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:24.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:25.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:25.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:25.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:25.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:26.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:26.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:26.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:26.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:27.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:27.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:27.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:27.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:28.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:28.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:28.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:28.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:29.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:29.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:29.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:29.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:30.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:30.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:30.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:30.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:31.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:31.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:31.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:31.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:32.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:32.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:32.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:32.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:33.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:33.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:33.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:33.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:34.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:34.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:34.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:34.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:35.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:35.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:35.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:35.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:36.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:36.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:36.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:36.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:37.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:37.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:37.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:37.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:38.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:38.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:38.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:38.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:39.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:39.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:39.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:39.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:40.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:40.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:40.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:40.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:41.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:41.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:41.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:41.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:41.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:41.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:42.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:42.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:43.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:43.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:43.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:43.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:43.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:43.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:44.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:44.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:44.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:44.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:45.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:45.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:45.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:45.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:46.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:46.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:46.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:46.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:47.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:47.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:47.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:47.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:48.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:48.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:48.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:48.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:49.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:49.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:49.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:49.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:50.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:50.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:50.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:50.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:51.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:51.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:51.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:51.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:52.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:52.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:52.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:52.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:53.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:53.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:53.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:53.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:54.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:54.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:54.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:54.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:55.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:55.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:55.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:55.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:56.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:56.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:57.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:57.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:57.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:57.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:57.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:57.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:58.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:58.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:59.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:52:59.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:52:59.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:52:59.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:00.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:00.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:00.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:00.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:00.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:00.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:01.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:01.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:02.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:02.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:02.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:02.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:03.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:03.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:03.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:03.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:04.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:04.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:04.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:04.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:05.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:05.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:05.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:05.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:06.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:06.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:06.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:06.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:07.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:07.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:07.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:07.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:08.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:08.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:08.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:08.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:09.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:09.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:09.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:09.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:10.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:10.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:10.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:10.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:11.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:11.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:11.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:11.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:12.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:12.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:12.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:12.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:13.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:13.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:13.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:13.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:14.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:14.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:14.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:14.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:15.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:15.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:15.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:15.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:15.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:15.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:16.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:16.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:17.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:17.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:17.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:17.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:17.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:17.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:18.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:18.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:19.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:19.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:19.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:19.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:19.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:19.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:20.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:20.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:20.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:20.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:21.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:21.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:21.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:21.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:22.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:22.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:22.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:22.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:23.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:23.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:23.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:23.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:24.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:24.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:24.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:24.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:25.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:25.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:25.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:25.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:26.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:26.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:26.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:26.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:27.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:27.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:27.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:27.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:28.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:28.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:28.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:28.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:29.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:29.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:29.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:29.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:30.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:30.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:30.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:30.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:31.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:31.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:31.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:31.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:32.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:32.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:32.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:32.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:33.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:33.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:33.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:33.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:34.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:34.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:34.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:34.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:35.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:35.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:35.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:35.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:36.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:36.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:37.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:37.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:37.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:37.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:37.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:37.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:38.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:38.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:38.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:38.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:39.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:39.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:39.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:39.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:40.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:40.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:40.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:40.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:41.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:41.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:42.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:42.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:42.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:42.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:42.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:42.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:43.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:43.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:44.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:44.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:44.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:44.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:45.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:45.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:45.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:45.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:45.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:45.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:46.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:46.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:46.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:46.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:47.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:47.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:47.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:47.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:48.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:48.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:48.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:48.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:49.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:49.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:49.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:49.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:50.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:50.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:50.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:50.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:51.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:51.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:51.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:51.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:52.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:52.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:52.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:52.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:53.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:53.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:53.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:53.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:54.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:54.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:54.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:54.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:55.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:55.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:56.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:56.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:56.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:56.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:57.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:57.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:57.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:57.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:58.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:58.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:58.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:58.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:59.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:53:59.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:53:59.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:53:59.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:00.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:00.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:00.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:00.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:01.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:01.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:01.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:01.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:02.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:02.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:02.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:02.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:03.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:03.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:03.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:03.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:04.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:04.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:04.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:04.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:05.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:05.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:05.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:05.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:06.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:06.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:06.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:06.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:07.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:07.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:07.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:07.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:08.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:08.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:08.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:08.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:09.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:09.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:09.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:09.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:10.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:10.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:10.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:10.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:11.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:11.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:11.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:11.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:12.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:12.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:12.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:12.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:13.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:13.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:13.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:13.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:14.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:14.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:14.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:14.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:15.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:15.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:15.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:15.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:16.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:16.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:16.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:16.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:17.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:17.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:17.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:17.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:18.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:18.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:18.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:18.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:19.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:19.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:19.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:19.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:20.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:20.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:20.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:20.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:21.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:21.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:21.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:21.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:22.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:22.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:22.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:22.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:23.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:23.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:23.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:23.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:24.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:24.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:24.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:24.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:25.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:25.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:25.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:25.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:26.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:26.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:26.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:26.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:27.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:27.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:27.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:27.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:28.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:28.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:29.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:29.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:29.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:29.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:29.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:29.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:30.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:30.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:30.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:30.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:30.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:30.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:31.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:31.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:31.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:31.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:32.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:32.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:32.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:32.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:33.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:33.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:33.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:33.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:34.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:34.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:34.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:34.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:35.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:35.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:35.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:35.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:36.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:36.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:36.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:36.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:37.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:37.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:38.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:38.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:38.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:38.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:39.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:39.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:39.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:39.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:40.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:40.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:40.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:40.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:41.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:41.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:41.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:41.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:42.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:42.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:42.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:42.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:43.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:43.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:43.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:43.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:44.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:44.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:44.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:44.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:45.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:45.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:45.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:45.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:46.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:46.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:46.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:46.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:47.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:47.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:47.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:47.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:48.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:48.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:48.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:48.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:49.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:49.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:49.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:49.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:50.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:50.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:50.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:50.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:50.939 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T00:54:50.936+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa403c310 msgr2=0x7f5fa40de540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T00:54:51.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:51.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:51.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:51.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:52.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:52.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:52.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:52.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:53.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:53.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:53.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:53.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:53.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:53.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:54.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:54.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:54.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:54.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:55.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:55.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:55.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:55.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:56.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:56.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:56.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:56.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:57.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:57.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:58.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:58.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:58.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:58.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:58.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:58.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:59.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:54:59.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:54:59.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:54:59.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:00.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:00.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:00.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:00.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:01.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:01.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:01.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:01.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:02.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:02.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:03.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:03.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:03.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:03.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:04.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:04.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:04.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:04.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:05.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:05.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:05.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:05.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:05.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:05.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:06.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:06.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:06.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:06.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:07.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:07.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:07.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:07.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:08.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:08.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:08.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:08.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:09.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:09.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:09.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:09.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:10.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:10.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:10.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:10.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:11.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:11.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:11.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:11.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:12.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:12.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:12.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:12.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:13.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:13.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:13.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:13.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:14.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:14.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:14.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:14.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:15.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:15.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:15.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:15.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:16.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:16.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:17.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:16.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:17.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:17.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:18.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:18.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:18.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:18.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:19.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:19.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:19.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:19.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:20.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:20.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:20.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:20.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:21.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:21.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:21.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:21.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:22.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:22.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:22.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:22.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:23.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:23.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:23.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:23.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:24.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:24.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:24.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:24.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:25.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:25.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:25.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:25.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:26.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:26.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:26.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:26.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:27.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:27.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:27.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:27.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:28.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:28.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:28.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:28.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:29.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:29.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:29.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:30.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:30.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:30.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:30.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:31.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:31.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:31.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:31.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:32.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:32.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:32.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:32.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:33.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:33.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:33.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:33.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:34.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:34.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:34.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:34.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:35.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:35.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:35.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:35.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:36.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:36.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:36.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:36.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:37.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:37.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:37.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:37.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:38.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:38.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:38.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:38.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:39.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:39.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:39.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:39.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:40.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:40.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:40.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:40.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:41.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:41.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:41.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:41.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:42.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:42.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:42.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:42.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:43.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:43.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:43.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:43.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:44.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:44.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:44.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:44.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:45.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:45.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:45.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:45.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:46.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:46.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:46.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:46.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:47.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:47.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:47.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:47.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:48.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:48.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:49.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:49.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:49.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:49.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:49.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:49.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:50.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:50.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:50.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:50.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:51.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:51.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:51.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:51.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:52.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:52.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:52.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:52.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:53.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:53.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:53.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:53.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:54.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:54.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:54.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:54.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:55.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:55.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:55.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:55.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:56.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:56.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:56.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:56.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:57.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:57.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:57.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:57.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:58.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:58.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:58.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:58.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:59.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:55:59.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:55:59.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:55:59.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:00.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:00.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:00.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:00.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:01.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:01.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:01.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:01.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:02.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:02.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:02.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:02.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:03.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:03.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:03.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:03.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:04.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:04.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:04.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:04.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:05.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:05.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:05.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:05.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:06.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:06.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:06.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:06.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:07.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:07.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:07.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:07.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:08.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:08.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:08.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:08.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:09.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:09.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:09.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:09.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:10.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:10.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:10.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:10.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:11.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:11.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:11.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:11.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:12.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:12.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:12.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:12.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:13.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:13.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:13.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:13.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:14.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:14.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:14.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:14.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:15.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:15.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:15.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:15.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:16.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:16.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:16.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:16.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:17.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:17.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:18.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:18.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:18.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:18.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:18.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:18.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:19.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:19.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:19.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:19.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:20.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:20.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:20.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:20.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:21.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:21.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:21.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:21.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:22.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:22.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:22.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:22.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:23.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:23.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:23.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:23.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:24.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:24.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:24.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:24.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:25.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:25.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:25.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:25.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:26.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:26.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:26.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:26.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:27.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:27.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:27.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:27.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:28.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:28.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:28.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:28.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:29.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:29.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:29.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:29.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:30.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:30.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:30.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:30.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:31.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:31.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:31.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:31.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:32.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:32.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:32.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:32.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:33.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:33.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:33.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:33.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:34.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:34.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:34.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:34.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:35.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:35.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:35.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:35.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:36.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:36.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:36.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:36.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:37.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:37.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:37.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:37.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:38.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:38.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:38.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:38.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:39.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:39.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:40.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:39.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:40.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:40.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:40.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:40.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:41.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:41.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:42.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:42.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:42.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:42.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:43.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:43.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:43.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:43.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:44.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:44.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:44.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:44.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:45.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:45.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:45.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:45.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:46.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:46.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:46.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:46.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:47.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:47.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:47.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:47.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:48.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:48.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:48.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:48.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:49.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:49.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:49.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:49.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:50.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:50.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:50.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:50.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:51.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:51.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:51.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:51.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:52.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:52.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:52.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:52.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:53.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:53.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:53.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:53.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:54.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:54.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:54.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:54.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:55.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:55.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:55.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:55.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:56.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:56.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:56.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:56.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:57.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:57.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:57.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:57.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:58.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:58.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:58.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:58.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:59.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:56:59.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:56:59.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:56:59.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:00.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:00.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:00.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:00.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:01.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:01.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:01.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:01.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:02.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:02.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:02.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:02.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:03.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:03.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:03.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:03.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:04.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:04.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:04.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:04.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:05.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:05.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:05.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:05.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:06.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:06.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:06.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:06.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:07.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:07.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:07.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:07.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:08.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:08.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:08.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:08.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:09.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:09.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:09.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:09.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:10.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:10.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:10.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:10.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:11.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:11.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:11.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:11.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:12.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:12.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:12.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:12.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:13.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:13.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:13.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:13.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:14.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:14.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:14.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:14.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:15.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:15.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:15.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:15.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:16.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:16.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:16.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:16.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:17.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:17.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:17.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:17.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:18.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:18.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:18.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:18.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:19.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:19.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:19.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:19.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:20.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:20.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:20.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:20.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:21.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:21.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:21.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:21.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:22.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:22.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:22.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:22.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:23.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:23.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:23.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:23.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:24.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:24.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:24.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:24.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:25.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:25.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:25.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:25.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:26.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:26.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:26.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:26.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:27.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:27.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:27.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:27.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:28.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:28.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:28.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:28.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:29.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:29.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:29.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:29.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:30.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:30.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:30.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:30.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:31.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:31.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:31.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:31.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:32.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:32.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:32.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:32.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:33.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:33.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:33.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:33.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:34.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:34.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:34.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:34.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:35.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:35.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:35.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:35.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:36.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:36.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:36.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:36.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:37.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:37.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:37.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:37.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:38.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:38.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:38.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:38.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:39.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:39.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:39.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:39.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:40.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:40.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:40.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:40.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:41.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:41.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:41.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:41.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:42.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:42.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:42.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:42.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:43.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:43.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:43.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:43.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:44.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:44.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:44.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:44.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:45.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:45.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:45.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:45.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:46.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:46.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:46.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:46.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:47.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:47.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:47.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:47.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:48.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:48.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:48.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:48.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:49.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:49.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:49.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:49.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:50.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:50.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:50.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:50.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:51.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:51.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:51.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:51.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:52.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:52.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:52.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:52.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:53.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:53.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:53.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:53.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:54.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:54.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:54.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:54.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:55.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:55.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:55.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:55.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:56.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:56.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:56.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:56.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:57.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:57.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:57.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:57.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:58.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:58.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:58.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:58.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:59.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:57:59.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:57:59.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:57:59.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:00.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:00.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:00.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:00.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:01.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:01.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:01.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:01.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:02.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:02.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:02.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:02.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:03.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:03.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:03.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:03.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:04.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:04.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:04.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:04.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:05.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:05.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:05.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:05.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:06.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:06.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:06.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:06.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:07.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:07.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:07.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:07.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:08.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:08.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:08.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:08.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:09.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:09.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:09.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:09.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:10.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:10.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:10.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:10.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:11.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:11.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:11.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:11.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:12.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:12.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:12.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:12.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:13.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:13.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:13.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:13.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:14.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:14.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:14.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:14.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:15.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:15.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:15.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:15.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:16.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:16.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:16.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:16.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:17.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:17.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:17.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:17.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:18.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:18.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:18.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:18.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:19.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:19.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:19.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:19.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:20.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:20.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:20.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:20.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:21.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:21.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:21.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:21.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:22.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:22.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:22.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:22.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:23.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:23.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:23.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:23.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:24.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:24.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:24.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:24.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:25.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:25.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:25.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:25.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:26.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:26.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:26.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:26.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:27.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:27.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:27.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:27.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:28.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:28.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:28.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:28.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:29.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:29.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:29.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:29.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:30.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:30.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:30.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:30.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:31.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:31.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:31.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:31.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:32.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:32.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:32.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:32.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:33.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:33.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:33.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:33.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:34.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:34.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:34.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:34.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:35.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:35.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:35.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:35.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:36.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:36.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:36.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:36.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:37.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:37.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:37.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:37.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:38.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:38.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:38.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:38.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:39.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:39.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:39.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:39.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:40.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:40.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:40.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:40.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:41.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:41.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:41.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:41.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:42.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:42.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:42.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:42.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:43.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:43.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:43.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:43.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:44.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:44.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:44.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:44.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:45.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:45.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:45.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:45.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:46.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:46.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:46.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:46.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:47.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:47.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:47.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:47.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:48.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:48.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:48.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:48.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:49.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:49.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:49.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:49.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:50.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:50.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:50.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:50.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:51.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:51.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:51.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:51.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:52.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:52.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:52.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:52.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:53.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:53.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:53.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:53.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:54.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:54.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:54.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:54.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:55.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:55.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:55.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:55.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:56.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:56.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:56.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:56.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:57.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:57.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:57.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:57.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:58.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:58.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:58.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:58.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:59.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:58:59.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:58:59.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:58:59.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:00.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:00.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:00.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:00.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:01.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:01.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:01.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:01.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:02.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:02.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:02.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:02.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:03.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:03.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:03.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:03.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:04.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:04.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:04.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:04.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:05.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:05.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:05.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:05.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:06.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:06.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:06.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:06.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:07.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:07.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:07.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:07.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:08.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:08.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:08.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:08.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:09.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:09.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:09.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:09.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:10.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:10.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:10.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:10.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:11.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:11.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:11.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:11.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:12.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:12.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:12.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:12.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:13.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:13.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:13.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:13.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:14.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:14.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:14.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:14.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:15.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:15.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:15.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:15.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:16.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:16.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:16.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:16.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:17.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:17.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:17.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:17.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:18.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:18.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:18.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:18.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:19.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:19.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:19.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:19.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:20.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:20.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:20.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:20.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:21.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:21.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:21.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:21.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:22.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:22.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:22.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:22.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:23.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:23.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:23.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:23.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:24.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:24.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:24.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:24.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:25.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:25.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:25.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:25.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:26.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:26.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:26.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:26.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:27.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:27.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:27.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:27.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:28.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:28.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:28.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:28.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:29.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:29.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:29.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:29.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:30.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:30.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:30.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:30.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:31.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:31.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:31.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:31.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:32.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:32.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:32.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:32.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:33.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:33.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:33.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:33.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:34.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:34.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:34.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:34.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:35.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:35.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:35.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:35.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:36.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:36.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:36.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:36.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:37.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:37.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:37.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:37.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:38.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:38.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:38.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:38.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:39.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:39.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:39.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:39.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:40.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:40.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:40.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:40.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:41.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:41.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:41.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:41.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:42.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:42.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:42.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:42.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:43.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:43.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:43.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:43.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:44.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:44.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:44.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:44.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:45.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:45.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:45.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:45.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:46.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:46.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:46.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:46.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:47.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:47.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:47.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:47.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:48.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:48.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:48.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:48.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:49.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:49.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:49.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:49.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:50.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:50.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:50.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:50.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:51.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:51.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:51.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:51.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:52.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:52.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:52.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:52.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:53.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:53.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:53.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:53.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:54.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:54.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:54.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:54.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:55.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:55.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:55.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:55.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:56.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:56.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:56.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:56.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:57.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:57.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:57.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:57.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:58.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:58.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:58.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:58.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:59.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T00:59:59.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T00:59:59.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T00:59:59.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:00.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:00.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:00.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:00.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:01.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:01.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:01.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:01.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:02.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:02.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:02.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:02.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:03.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:03.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:03.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:03.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:04.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:04.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:04.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:04.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:05.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:05.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:05.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:05.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:06.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:06.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:06.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:06.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:07.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:07.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:07.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:07.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:08.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:08.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:08.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:08.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:09.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:09.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:09.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:09.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:10.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:10.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:10.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:10.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:11.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:11.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:11.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:11.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:12.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:12.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:12.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:12.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:13.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:13.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:13.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:13.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:14.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:14.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:14.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:14.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:15.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:15.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:15.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:15.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:16.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:16.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:16.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:16.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:17.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:17.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:17.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:17.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:18.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:18.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:18.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:18.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:19.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:19.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:19.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:19.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:20.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:20.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:20.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:20.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:21.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:21.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:22.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:22.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:22.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:22.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:23.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:23.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:23.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:23.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:23.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:23.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:24.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:24.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:24.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:24.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:25.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:25.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:25.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:25.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:26.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:26.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:26.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:26.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:27.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:27.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:27.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:27.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:28.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:28.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:28.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:28.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:29.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:29.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:29.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:29.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:30.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:30.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:30.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:30.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:31.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:31.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:31.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:31.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:32.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:32.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:32.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:32.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:33.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:33.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:33.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:33.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:34.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:34.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:34.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:34.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:35.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:35.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:35.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:35.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:36.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:36.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:36.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:36.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:37.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:37.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:37.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:37.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:38.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:38.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:38.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:38.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:39.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:39.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:39.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:39.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:40.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:40.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:40.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:40.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:41.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:41.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:41.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:41.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:42.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:42.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:42.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:42.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:43.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:43.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:43.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:43.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:44.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:44.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:44.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:44.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:45.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:45.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:45.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:45.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:46.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:46.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:46.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:46.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:47.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:47.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:47.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:47.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:48.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:48.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:48.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:48.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:49.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:49.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:49.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:49.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:50.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:50.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:50.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:50.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:51.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:51.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:51.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:51.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:52.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:52.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:52.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:52.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:53.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:53.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:53.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:53.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:54.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:54.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:54.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:54.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:55.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:55.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:55.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:55.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:56.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:56.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:56.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:56.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:57.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:57.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:57.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:57.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:58.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:58.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:58.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:58.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:59.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:00:59.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:00:59.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:00:59.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:00.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:00.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:00.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:00.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:01.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:01.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:01.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:01.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:02.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:02.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:02.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:02.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:03.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:03.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:03.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:03.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:04.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:04.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:04.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:04.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:05.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:05.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:06.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:05.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:06.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:06.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:07.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:07.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:07.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:07.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:08.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:08.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:08.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:08.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:09.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:09.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:09.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:09.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:10.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:10.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:10.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:10.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:11.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:11.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:11.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:11.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:12.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:12.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:12.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:12.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:13.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:13.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:13.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:13.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:14.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:14.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:14.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:14.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:14.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:14.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:15.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:15.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:15.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:15.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:16.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:16.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:16.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:16.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:17.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:17.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:17.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:17.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:18.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:18.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:18.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:18.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:19.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:19.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:19.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:19.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:20.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:20.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:20.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:20.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:21.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:21.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:21.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:21.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:22.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:22.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:22.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:22.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:23.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:23.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:23.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:23.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:24.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:24.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:24.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:24.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:25.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:25.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:25.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:25.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:26.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:26.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:26.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:26.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:27.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:27.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:27.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:27.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:28.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:28.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:28.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:28.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:29.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:29.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:29.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:29.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:30.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:30.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:30.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:30.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:31.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:31.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:31.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:31.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:32.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:32.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:32.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:32.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:33.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:33.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:33.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:33.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:34.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:34.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:34.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:34.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:35.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:35.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:35.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:35.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:36.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:36.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:36.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:36.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:37.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:37.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:37.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:37.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:38.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:38.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:38.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:38.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:39.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:39.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:39.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:39.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:40.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:40.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:40.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:40.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:41.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:41.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:41.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:41.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:42.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:42.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:43.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:43.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:43.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:43.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:44.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:44.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:44.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:44.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:45.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:45.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:45.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:45.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:46.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:46.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:46.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:46.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:47.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:47.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:47.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:47.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:48.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:48.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:48.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:48.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:49.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:49.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:49.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:49.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:50.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:50.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:50.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:50.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:51.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:51.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:51.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:51.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:52.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:52.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:52.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:52.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:53.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:53.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:53.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:53.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:54.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:54.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:54.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:54.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:55.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:55.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:55.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:55.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:56.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:56.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:56.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:56.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:57.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:57.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:57.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:57.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:58.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:58.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:58.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:58.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:59.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:01:59.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:01:59.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:01:59.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:00.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:00.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:00.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:00.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:01.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:01.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:01.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:01.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:02.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:02.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:02.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:02.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:03.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:03.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:03.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:03.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:04.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:04.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:04.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:04.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:05.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:05.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:05.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:05.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:06.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:06.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:06.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:06.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:07.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:07.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:07.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:07.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:08.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:08.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:08.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:08.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:09.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:09.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:09.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:09.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:10.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:10.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:10.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:10.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:11.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:11.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:11.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:11.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:12.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:12.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:13.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:13.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:13.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:13.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:13.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:13.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:14.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:14.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:14.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:14.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:15.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:15.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:15.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:15.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:16.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:16.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:16.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:16.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:17.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:17.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:17.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:17.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:18.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:18.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:18.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:18.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:19.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:19.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:19.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:19.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:20.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:20.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:20.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:20.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:21.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:21.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:21.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:21.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:22.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:22.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:22.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:22.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:23.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:23.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:24.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:23.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:24.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:24.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:25.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:25.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:25.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:25.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:26.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:26.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:26.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:26.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:27.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:27.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:27.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:27.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:28.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:28.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:28.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:28.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:29.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:29.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:29.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:29.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:30.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:30.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:30.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:30.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:31.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:31.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:31.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:31.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:32.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:32.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:32.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:32.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:33.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:33.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:33.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:33.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:34.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:34.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:34.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:34.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:35.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:35.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:35.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:35.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:36.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:36.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:36.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:36.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:37.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:37.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:37.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:37.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:38.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:38.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:38.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:38.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:39.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:39.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:39.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:39.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:40.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:40.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:40.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:40.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:41.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:41.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:41.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:41.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:42.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:42.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:42.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:42.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:43.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:43.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:43.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:43.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:44.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:44.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:44.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:44.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:45.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:45.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:45.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:45.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:46.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:46.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:46.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:46.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:47.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:47.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:47.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:47.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:48.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:48.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:48.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:48.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:49.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:49.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:49.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:49.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:50.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:50.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:50.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:50.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:51.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:51.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:51.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:51.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:52.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:52.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:52.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:52.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:53.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:53.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:53.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:53.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:54.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:54.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:54.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:54.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:55.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:55.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:55.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:55.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:56.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:56.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:56.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:56.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:57.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:57.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:57.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:57.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:58.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:58.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:58.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:58.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:59.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:02:59.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:02:59.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:02:59.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:00.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:00.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:00.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:00.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:01.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:01.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:01.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:01.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:02.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:02.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:02.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:02.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:03.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:03.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:03.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:03.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:04.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:04.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:04.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:04.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:05.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:05.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:05.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:05.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:06.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:06.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:06.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:06.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:07.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:07.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:07.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:07.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:08.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:08.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:08.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:08.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:09.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:09.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:09.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:09.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:10.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:10.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:10.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:10.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:11.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:11.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:11.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:11.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:12.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:12.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:12.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:12.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:13.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:13.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:13.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:13.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:14.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:14.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:14.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:14.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:15.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:15.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:15.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:15.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:16.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:16.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:16.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:16.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:17.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:17.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:17.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:17.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:18.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:18.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:18.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:18.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:19.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:19.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:19.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:19.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:20.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:20.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:20.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:20.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:21.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:21.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:21.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:21.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:22.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:22.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:22.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:22.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:23.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:23.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:23.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:23.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:24.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:24.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:24.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:24.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:25.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:25.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:25.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:25.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:26.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:26.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:26.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:26.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:27.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:27.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:27.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:27.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:28.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:28.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:28.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:28.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:29.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:29.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:29.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:29.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:30.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:30.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:30.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:30.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:31.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:31.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:31.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:31.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:32.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:32.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:32.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:32.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:33.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:33.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:33.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:33.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:34.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:34.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:34.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:34.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:35.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:35.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:35.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:35.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:36.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:36.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:36.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:36.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:37.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:37.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:37.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:37.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:38.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:38.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:38.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:38.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:39.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:39.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:39.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:39.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:40.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:40.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:40.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:40.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:41.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:41.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:41.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:41.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:42.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:42.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:42.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:42.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:43.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:43.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:43.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:43.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:44.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:44.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:44.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:44.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:45.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:45.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:45.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:45.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:46.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:46.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:46.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:46.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:47.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:47.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:47.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:47.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:48.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:48.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:48.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:48.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:49.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:49.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:49.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:49.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:50.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:50.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:50.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:50.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:51.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:51.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:51.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:51.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:52.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:52.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:52.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:52.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:53.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:53.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:53.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:53.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:54.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:54.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:54.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:54.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:55.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:55.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:55.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:55.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:56.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:56.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:56.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:56.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:57.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:57.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:57.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:57.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:58.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:58.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:58.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:58.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:59.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:03:59.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:03:59.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:03:59.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:00.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:00.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:00.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:00.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:01.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:01.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:01.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:01.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:02.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:02.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:02.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:02.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:03.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:03.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:03.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:03.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:04.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:04.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:04.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:04.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:05.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:05.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:05.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:05.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:06.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:06.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:06.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:06.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:07.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:07.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:07.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:07.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:08.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:08.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:08.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:08.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:09.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:09.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:09.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:09.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:10.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:10.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:10.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:10.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:11.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:11.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:11.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:11.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:12.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:12.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:12.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:12.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:13.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:13.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:13.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:13.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:14.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:14.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:14.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:14.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:15.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:15.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:16.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:16.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:16.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:16.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:16.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:16.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:17.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:17.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:17.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:17.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:18.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:18.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:18.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:18.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:19.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:19.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:19.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:19.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:20.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:20.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:20.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:20.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:21.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:21.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:21.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:21.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:22.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:22.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:22.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:22.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:23.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:23.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:23.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:23.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:24.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:24.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:24.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:24.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:25.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:25.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:25.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:25.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:26.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:26.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:26.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:26.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:27.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:27.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:27.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:27.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:28.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:28.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:28.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:28.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:29.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:29.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:29.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:29.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:30.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:30.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:30.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:30.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:31.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:31.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:31.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:31.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:32.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:32.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:32.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:32.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:33.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:33.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:33.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:33.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:34.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:34.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:34.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:34.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:35.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:35.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:35.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:35.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:36.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:36.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:36.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:36.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:37.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:37.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:37.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:37.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:38.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:38.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:38.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:38.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:39.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:39.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:39.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:39.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:40.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:40.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:40.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:40.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:41.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:41.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:41.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:41.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:42.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:42.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:42.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:42.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:43.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:43.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:43.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:43.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:44.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:44.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:44.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:44.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:45.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:45.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:45.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:45.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:46.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:46.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:46.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:46.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:47.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:47.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:47.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:47.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:48.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:48.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:48.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:48.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:49.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:49.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:49.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:49.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:50.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:50.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:50.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:50.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:51.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:51.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:51.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:51.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:52.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:52.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:52.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:52.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:53.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:53.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:53.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:53.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:54.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:54.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:54.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:54.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:55.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:55.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:55.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:55.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:56.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:56.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:56.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:56.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:57.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:57.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:57.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:57.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:58.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:58.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:58.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:58.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:59.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:04:59.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:04:59.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:04:59.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:00.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:00.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:00.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:00.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:01.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:01.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:01.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:01.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:02.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:02.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:02.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:02.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:03.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:03.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:03.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:03.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:04.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:04.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:04.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:04.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:05.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:05.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:05.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:05.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:06.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:06.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:06.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:06.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:07.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:07.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:07.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:07.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:08.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:08.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:08.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:08.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:09.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:09.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:09.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:09.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:10.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:10.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:10.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:10.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:11.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:11.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:11.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:11.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:12.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:12.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:12.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:12.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:13.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:13.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:13.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:13.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:14.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:14.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:14.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:14.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:15.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:15.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:15.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:15.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:16.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:16.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:16.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:16.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:17.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:17.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:17.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:17.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:18.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:18.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:18.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:18.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:19.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:19.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:19.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:19.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:20.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:20.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:20.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:20.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:21.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:21.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:21.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:21.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:22.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:22.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:22.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:22.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:23.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:23.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:23.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:23.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:24.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:24.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:24.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:24.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:25.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:25.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:25.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:25.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:26.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:26.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:26.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:26.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:27.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:27.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:27.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:27.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:28.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:28.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:28.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:28.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:29.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:29.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:29.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:29.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:30.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:30.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:30.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:30.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:31.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:31.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:31.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:31.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:32.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:32.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:32.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:32.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:33.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:33.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:33.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:33.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:34.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:34.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:34.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:34.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:35.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:35.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:35.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:35.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:36.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:36.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:36.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:36.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:37.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:37.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:37.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:37.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:38.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:38.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:38.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:38.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:39.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:39.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:39.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:39.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:40.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:40.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:40.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:40.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:41.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:41.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:41.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:41.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:42.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:42.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:42.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:42.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:43.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:43.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:43.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:43.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:44.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:44.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:44.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:44.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:45.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:45.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:45.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:45.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:46.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:46.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:46.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:46.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:47.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:47.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:47.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:47.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:48.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:48.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:48.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:48.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:49.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:49.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:49.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:49.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:50.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:50.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:50.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:50.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:51.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:51.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:51.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:51.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:52.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:52.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:52.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:52.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:53.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:53.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:53.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:53.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:54.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:54.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:54.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:54.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:55.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:55.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:55.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:55.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:56.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:56.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:56.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:56.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:57.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:57.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:57.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:57.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:58.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:58.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:58.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:58.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:59.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:05:59.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:05:59.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:05:59.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:00.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:00.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:00.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:00.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:01.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:01.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:01.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:01.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:02.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:02.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:02.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:02.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:03.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:03.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:03.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:03.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:04.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:04.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:04.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:04.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:05.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:05.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:05.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:05.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:06.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:06.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:06.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:06.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:07.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:07.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:07.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:07.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:08.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:08.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:08.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:08.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:09.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:09.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:09.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:09.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:10.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:10.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:10.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:10.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:11.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:11.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:11.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:11.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:12.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:12.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:12.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:12.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:13.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:13.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:13.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:13.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:14.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:14.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:14.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:14.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:15.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:15.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:15.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:15.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:16.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:16.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:16.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:16.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:17.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:17.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:17.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:17.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:18.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:18.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:18.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:18.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:19.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:19.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:19.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:19.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:20.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:20.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:20.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:20.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:21.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:21.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:21.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:21.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:22.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:22.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:22.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:22.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:23.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:23.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:23.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:23.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:24.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:24.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:24.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:24.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:25.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:25.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:25.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:25.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:26.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:26.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:26.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:26.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:27.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:27.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:27.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:27.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:28.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:28.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:28.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:28.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:29.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:29.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:29.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:29.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:30.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:30.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:30.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:30.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:31.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:31.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:31.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:31.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:32.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:32.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:32.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:32.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:33.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:33.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:33.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:33.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:34.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:34.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:34.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:34.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:35.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:35.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:36.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:35.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:36.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:36.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:36.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:36.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:37.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:37.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:37.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:37.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:38.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:38.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:38.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:38.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:39.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:39.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:39.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:39.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:40.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:40.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:40.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:40.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:41.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:41.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:41.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:41.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:42.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:42.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:42.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:42.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:43.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:43.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:43.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:43.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:44.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:44.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:44.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:44.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:45.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:45.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:45.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:45.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:46.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:46.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:46.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:46.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:47.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:47.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:47.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:47.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:48.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:48.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:48.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:48.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:49.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:49.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:49.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:49.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:50.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:50.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:50.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:50.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:51.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:51.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:51.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:51.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:52.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:52.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:52.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:52.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:53.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:53.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:53.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:53.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:54.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:54.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:54.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:54.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:55.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:55.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:55.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:55.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:56.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:56.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:56.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:56.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:57.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:57.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:57.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:57.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:58.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:58.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:58.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:58.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:59.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:06:59.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:06:59.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:06:59.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:00.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:00.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:00.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:00.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:01.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:01.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:01.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:01.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:02.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:02.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:02.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:02.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:03.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:03.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:03.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:03.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:04.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:04.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:04.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:04.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:05.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:05.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:05.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:05.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:06.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:06.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:07.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:07.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:07.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:07.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:08.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:08.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:08.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:08.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:09.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:09.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:09.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:09.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:10.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:10.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:10.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:10.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:10.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:10.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:11.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:11.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:11.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:11.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:12.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:12.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:12.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:12.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:13.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:13.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:13.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:13.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:14.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:14.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:14.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:14.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:15.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:15.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:15.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:15.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:16.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:16.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:16.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:16.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:17.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:17.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:17.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:17.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:18.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:18.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:18.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:18.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:19.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:19.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:19.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:19.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:20.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:20.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:20.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:20.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:21.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:21.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:21.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:21.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:22.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:22.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:22.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:22.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:23.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:23.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:23.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:23.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:24.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:24.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:24.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:24.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:25.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:25.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:25.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:25.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:26.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:26.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:26.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:26.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:27.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:27.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:27.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:27.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:28.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:28.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:28.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:28.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:29.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:29.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:29.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:29.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:30.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:30.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:31.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:30.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:31.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:31.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:31.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:31.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:32.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:32.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:32.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:32.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:33.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:33.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:33.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:33.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:34.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:34.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:35.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:35.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:35.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:35.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:36.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:36.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:36.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:36.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:37.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:37.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:37.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:37.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:38.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:38.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:38.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:38.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:39.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:39.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:39.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:39.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:40.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:40.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:40.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:40.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:41.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:41.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:41.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:41.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:42.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:42.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:42.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:42.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:43.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:43.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:43.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:43.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:44.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:44.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:44.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:44.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:45.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:45.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:45.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:45.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:46.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:46.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:46.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:46.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:46.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:46.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:47.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:47.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:48.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:48.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:48.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:48.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:49.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:49.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:49.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:49.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:50.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:50.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:50.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:50.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:50.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:50.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:51.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:51.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:51.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:51.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:52.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:52.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:52.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:52.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:53.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:53.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:53.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:53.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:54.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:54.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:54.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:54.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:55.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:55.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:56.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:56.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:56.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:56.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:57.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:57.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:57.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:57.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:57.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:57.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:58.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:58.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:59.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:07:59.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:07:59.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:07:59.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:00.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:00.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:00.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:00.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:01.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:01.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:01.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:01.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:02.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:02.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:02.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:02.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:03.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:03.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:03.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:03.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:04.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:04.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:04.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:04.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:05.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:05.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:05.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:05.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:05.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:05.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:06.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:06.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:06.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:06.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:07.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:07.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:07.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:07.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:08.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:08.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:08.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:08.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:09.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:09.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:09.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:09.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:10.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:10.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:11.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:11.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:11.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:11.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:12.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:12.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:12.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:12.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:12.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:12.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:13.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:13.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:13.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:13.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:14.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:14.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:15.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:15.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:15.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:15.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:16.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:16.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:16.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:16.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:17.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:17.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:17.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:17.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:18.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:18.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:18.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:18.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:19.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:19.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:19.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:19.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:20.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:20.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:20.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:20.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:20.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:20.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:21.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:21.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:21.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:21.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:22.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:22.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:23.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:23.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:23.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:23.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:23.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:23.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:24.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:24.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:24.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:24.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:25.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:25.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:25.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:25.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:26.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:26.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:26.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:26.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:27.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:27.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:27.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:27.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:28.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:28.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:28.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:28.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:29.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:29.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:30.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:30.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:30.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:30.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:31.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:31.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:31.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:31.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:31.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:31.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:32.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:32.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:33.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:33.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:33.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:33.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:34.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:34.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:34.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:34.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:35.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:35.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:35.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:35.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:36.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:36.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:36.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:36.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:37.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:37.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:37.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:37.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:37.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:37.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:38.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:38.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:39.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:39.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:39.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:39.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:40.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:40.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:40.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:40.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:41.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:41.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:41.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:41.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:42.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:42.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:42.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:42.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:43.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:43.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:43.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:43.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:44.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:44.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:44.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:44.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:45.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:45.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:45.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:45.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:46.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:46.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:46.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:46.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:47.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:47.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:47.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:47.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:48.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:48.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:48.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:48.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:49.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:49.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:49.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:49.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:50.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:50.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:50.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:50.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:51.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:51.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:51.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:51.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:52.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:52.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:52.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:52.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:53.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:53.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:53.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:53.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:54.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:54.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:54.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:54.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:55.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:55.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:55.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:55.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:56.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:56.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:56.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:56.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:57.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:57.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:57.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:57.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:58.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:58.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:58.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:58.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:59.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:08:59.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:08:59.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:08:59.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:00.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:00.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:00.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:00.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:01.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:01.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:01.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:01.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:02.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:02.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:02.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:02.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:03.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:03.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:03.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:03.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:04.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:04.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:04.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:04.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:05.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:05.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:05.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:05.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:06.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:06.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:06.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:06.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:07.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:07.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:07.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:07.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:08.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:08.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:08.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:08.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:09.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:09.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:09.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:09.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:10.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:10.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:10.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:10.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:11.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:11.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:11.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:11.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:12.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:12.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:12.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:12.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:13.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:13.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:13.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:13.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:14.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:14.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:14.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:14.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:15.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:15.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:15.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:15.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:16.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:16.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:16.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:16.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:17.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:17.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:17.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:17.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:18.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:18.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:18.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:18.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:19.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:19.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:19.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:19.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:20.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:20.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:20.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:20.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:21.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:21.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:21.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:21.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:22.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:22.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:22.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:22.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:23.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:23.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:23.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:23.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:24.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:24.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:24.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:24.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:25.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:25.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:25.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:25.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:26.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:26.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:26.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:26.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:27.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:27.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:27.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:27.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:28.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:28.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:28.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:28.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:29.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:29.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:29.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:29.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:30.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:30.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:30.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:30.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:31.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:31.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:31.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:31.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:32.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:32.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:32.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:32.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:33.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:33.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:33.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:33.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:34.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:34.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:34.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:34.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:35.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:35.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:35.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:35.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:36.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:36.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:36.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:36.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:37.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:37.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:37.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:37.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:38.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:38.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:38.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:38.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:39.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:39.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:39.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:39.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:40.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:40.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:40.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:40.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:41.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:41.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:41.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:41.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:42.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:42.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:42.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:42.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:43.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:43.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:43.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:43.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:44.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:44.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:44.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:44.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:45.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:45.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:45.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:45.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:46.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:46.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:46.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:46.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:47.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:47.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:47.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:47.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:48.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:48.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:48.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:48.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:49.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:49.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:49.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:49.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:50.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:50.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:50.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:50.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:51.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:51.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:51.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:51.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:52.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:52.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:52.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:52.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:53.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:53.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:53.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:53.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:54.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:54.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:54.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:54.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:55.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:55.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:55.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:55.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:56.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:56.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:56.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:56.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:57.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:57.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:57.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:57.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:58.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:58.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:58.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:58.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:59.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:09:59.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:09:59.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:09:59.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:00.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:00.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:00.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:00.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:01.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:01.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:01.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:01.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:02.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:02.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:02.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:02.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:03.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:03.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:04.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:04.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:04.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:04.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:05.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:04.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:05.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:05.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:05.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:05.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:06.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:06.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:06.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:06.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:07.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:07.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:07.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:07.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:08.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:08.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:08.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:08.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:09.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:09.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:09.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:09.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:10.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:10.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:11.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:11.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:11.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:11.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:12.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:12.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:12.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:12.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:13.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:13.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:13.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:13.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:14.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:13.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:14.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:14.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:15.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:15.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:15.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:15.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:16.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:16.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:16.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:16.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:17.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:17.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:17.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:17.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:18.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:18.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:18.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:18.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:19.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:19.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:19.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:19.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:20.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:20.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:20.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:20.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:21.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:21.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:21.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:21.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:22.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:22.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:22.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:22.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:23.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:22.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:23.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:23.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:23.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:23.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:24.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:24.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:24.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:24.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:25.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:25.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:26.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:26.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:26.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:26.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:27.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:27.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:27.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:27.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:28.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:28.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:28.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:28.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:29.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:29.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:29.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:29.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:30.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:30.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:30.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:30.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:31.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:31.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:31.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:31.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:32.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:32.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:32.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:32.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:33.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:33.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:33.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:33.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:34.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:34.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:34.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:34.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:35.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:35.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:35.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:35.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:36.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:36.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:36.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:36.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:37.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:37.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:37.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:37.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:38.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:38.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:38.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:38.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:39.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:39.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:39.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:39.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:40.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:40.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:40.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:40.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:41.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:41.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:41.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:41.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:42.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:42.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:42.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:42.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:43.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:43.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:43.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:43.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:44.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:44.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:44.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:44.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:45.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:45.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:45.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:45.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:46.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:46.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:46.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:46.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:47.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:47.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:47.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:47.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:48.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:48.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:48.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:48.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:49.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:49.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:49.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:49.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:50.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:50.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:50.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:50.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:51.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:51.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:51.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:51.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:52.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:52.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:52.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:52.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:53.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:53.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:53.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:53.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:54.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:54.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:54.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:54.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:55.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:55.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:55.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:55.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:56.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:56.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:56.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:57.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:57.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:57.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:57.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:58.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:58.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:58.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:58.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:59.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:10:59.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:10:59.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:10:59.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:00.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:00.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:00.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:00.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:01.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:01.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:01.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:01.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:02.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:02.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:02.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:02.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:03.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:03.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:03.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:03.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:04.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:04.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:04.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:04.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:05.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:05.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:05.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:05.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:06.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:06.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:06.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:06.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:07.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:07.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:07.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:07.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:08.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:08.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:08.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:08.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:09.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:09.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:09.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:09.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:10.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:10.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:10.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:10.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:11.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:11.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:11.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:11.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:12.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:12.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:12.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:12.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:13.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:13.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:13.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:13.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:14.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:14.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:14.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:14.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:15.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:15.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:15.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:15.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:16.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:16.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:16.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:16.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:17.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:17.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:17.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:17.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:18.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:18.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:18.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:18.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:19.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:19.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:19.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:19.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:20.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:20.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:20.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:20.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:21.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:21.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:21.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:21.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:22.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:22.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:22.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:22.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:23.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:23.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:23.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:23.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:24.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:24.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:24.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:24.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:25.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:25.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:25.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:25.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:26.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:26.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:26.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:26.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:27.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:27.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:27.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:27.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:28.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:28.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:28.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:28.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:29.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:29.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:29.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:29.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:30.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:30.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:30.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:30.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:31.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:31.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:31.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:31.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:32.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:32.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:32.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:32.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:33.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:33.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:33.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:33.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:34.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:34.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:34.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:34.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:35.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:35.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:35.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:35.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:36.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:36.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:36.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:36.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:37.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:37.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:37.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:37.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:38.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:38.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:38.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:38.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:39.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:39.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:39.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:39.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:40.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:40.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:40.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:40.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:41.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:41.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:41.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:41.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:42.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:42.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:42.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:42.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:43.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:43.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:43.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:43.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:44.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:44.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:44.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:44.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:45.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:45.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:45.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:45.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:46.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:46.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:46.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:46.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:47.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:47.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:47.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:47.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:48.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:48.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:48.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:48.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:49.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:49.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:49.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:49.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:50.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:50.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:50.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:50.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:51.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:51.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:51.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:51.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:52.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:52.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:52.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:52.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:53.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:53.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:53.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:53.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:54.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:54.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:54.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:54.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:55.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:55.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:55.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:55.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:56.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:56.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:56.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:56.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:57.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:57.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:57.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:57.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:58.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:58.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:58.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:58.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:59.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:11:59.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:11:59.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:11:59.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:00.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:00.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:00.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:00.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:01.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:01.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:01.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:01.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:02.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:02.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:02.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:02.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:03.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:03.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:03.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:03.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:04.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:04.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:04.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:04.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:05.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:05.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:05.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:05.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:06.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:06.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:06.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:06.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:07.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:07.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:07.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:07.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:08.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:08.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:08.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:08.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:09.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:09.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:09.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:09.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:10.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:10.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:10.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:10.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:11.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:11.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:11.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:11.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:12.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:12.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:12.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:12.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:13.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:13.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:13.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:13.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:14.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:14.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:14.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:14.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:15.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:15.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:15.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:15.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:16.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:16.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:16.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:16.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:17.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:17.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:17.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:17.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:18.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:18.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:18.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:18.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:19.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:19.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:19.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:19.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:20.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:20.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:20.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:20.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:21.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:21.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:21.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:21.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:22.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:22.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:22.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:22.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:23.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:23.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:23.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:23.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:24.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:24.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:24.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:24.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:25.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:25.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:25.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:25.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:26.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:26.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:26.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:26.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:27.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:27.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:27.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:27.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:28.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:28.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:29.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:28.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:29.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:29.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:30.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:30.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:30.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:30.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:31.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:31.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:31.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:31.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:32.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:32.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:32.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:32.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:33.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:33.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:33.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:33.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:34.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:34.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:34.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:34.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:35.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:35.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:35.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:35.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:36.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:36.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:36.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:36.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:37.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:37.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:37.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:37.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:38.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:38.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:38.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:38.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:39.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:39.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:39.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:39.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:40.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:40.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:40.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:40.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:41.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:41.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:41.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:41.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:42.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:42.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:42.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:42.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:43.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:43.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:43.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:43.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:44.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:44.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:44.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:44.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:45.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:45.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:45.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:45.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:46.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:46.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:46.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:46.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:46.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:46.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:47.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:47.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:47.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:48.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:48.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:48.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:48.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:49.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:49.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:50.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:50.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:50.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:50.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:51.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:51.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:51.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:51.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:52.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:52.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:52.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:52.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:53.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:53.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:53.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:53.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:54.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:54.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:54.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:54.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:55.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:55.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:55.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:55.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:56.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:56.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:56.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:56.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:57.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:57.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:57.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:57.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:58.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:58.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:58.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:58.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:59.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:12:59.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:12:59.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:12:59.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:00.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:00.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:00.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:00.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:01.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:01.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:01.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:01.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:02.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:02.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:02.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:02.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:03.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:03.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:03.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:03.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:04.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:04.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:04.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:04.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:05.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:05.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:05.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:05.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:06.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:06.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:06.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:06.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:07.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:07.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:07.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:07.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:08.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:08.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:08.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:08.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:09.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:09.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:09.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:09.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:10.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:10.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:10.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:10.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:11.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:11.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:11.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:11.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:12.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:12.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:12.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:12.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:13.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:13.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:13.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:13.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:14.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:14.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:14.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:14.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:15.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:15.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:15.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:15.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:16.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:16.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:16.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:16.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:17.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:17.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:17.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:17.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:18.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:18.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:18.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:18.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:19.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:19.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:19.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:19.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:20.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:20.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:20.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:20.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:21.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:21.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:21.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:21.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:22.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:22.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:22.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:22.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:23.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:23.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:23.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:23.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:24.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:24.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:24.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:24.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:25.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:25.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:25.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:25.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:26.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:26.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:26.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:26.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:27.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:27.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:27.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:27.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:28.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:28.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:28.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:28.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:29.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:29.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:29.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:29.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:30.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:30.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:30.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:30.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:31.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:31.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:31.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:31.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:32.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:32.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:32.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:32.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:33.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:33.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:33.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:33.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:34.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:34.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:34.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:34.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:35.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:35.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:35.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:35.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:36.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:36.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:36.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:36.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:37.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:37.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:37.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:37.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:38.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:38.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:38.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:38.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:39.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:39.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:39.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:39.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:40.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:40.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:40.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:40.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:41.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:41.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:41.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:41.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:42.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:42.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:42.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:42.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:43.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:43.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:43.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:43.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:44.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:44.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:44.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:44.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:45.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:45.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:45.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:45.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:46.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:46.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:46.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:46.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:47.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:47.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:47.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:47.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:48.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:48.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:48.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:48.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:49.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:49.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:49.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:49.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:50.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:50.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:50.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:50.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:51.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:51.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:51.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:51.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:52.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:52.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:52.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:52.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:53.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:53.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:53.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:53.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:54.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:54.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:54.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:54.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:55.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:55.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:55.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:55.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:56.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:56.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:56.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:56.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:57.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:57.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:57.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:57.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:58.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:58.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:58.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:58.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:59.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:13:59.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:13:59.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:13:59.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:00.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:00.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:00.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:00.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:01.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:01.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:01.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:01.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:02.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:02.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:02.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:02.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:03.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:03.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:03.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:03.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:04.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:04.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:04.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:04.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:05.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:05.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:05.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:05.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:06.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:06.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:06.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:06.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:07.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:07.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:07.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:07.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:08.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:08.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:08.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:08.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:09.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:09.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:09.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:09.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:10.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:10.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:10.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:10.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:11.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:11.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:11.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:11.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:12.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:12.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:12.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:12.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:13.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:13.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:13.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:13.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:14.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:14.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:14.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:14.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:15.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:15.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:15.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:15.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:16.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:16.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:16.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:16.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:17.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:17.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:17.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:17.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:18.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:18.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:18.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:18.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:19.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:19.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:19.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:19.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:20.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:20.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:20.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:20.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:21.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:21.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:21.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:21.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:22.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:22.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:22.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:22.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:23.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:23.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:23.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:23.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:24.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:24.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:24.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:24.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:25.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:25.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:25.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:25.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:26.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:26.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:26.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:26.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:27.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:27.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:27.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:27.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:28.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:28.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:28.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:28.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:29.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:29.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:29.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:29.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:30.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:30.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:30.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:30.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:31.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:31.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:31.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:31.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:32.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:32.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:32.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:32.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:33.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:33.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:33.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:33.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:34.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:34.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:34.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:34.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:35.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:35.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:35.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:35.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:36.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:36.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:37.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:37.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:37.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:37.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:38.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:37.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:38.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:38.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:39.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:39.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:39.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:39.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:40.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:40.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:40.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:40.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:41.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:41.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:41.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:41.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:42.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:42.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:42.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:42.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:43.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:43.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:43.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:43.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:44.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:44.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:44.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:44.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:45.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:45.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:45.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:45.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:46.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:46.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:46.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:46.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:47.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:47.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:47.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:47.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:48.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:48.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:48.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:48.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:49.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:49.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:49.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:49.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:50.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:50.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:50.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:50.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:51.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:51.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:51.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:51.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:52.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:52.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:52.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:52.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:53.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:53.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:53.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:53.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:54.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:54.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:54.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:54.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:55.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:55.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:55.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:55.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:56.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:56.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:56.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:56.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:57.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:57.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:57.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:57.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:58.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:58.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:58.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:58.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:59.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:14:59.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:14:59.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:14:59.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:00.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:00.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:00.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:00.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:01.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:01.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:01.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:01.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:02.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:02.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:02.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:02.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:03.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:03.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:03.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:03.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:04.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:04.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:04.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:04.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:05.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:05.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:05.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:05.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:06.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:06.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:06.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:06.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:07.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:07.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:07.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:07.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:08.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:08.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:08.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:08.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:09.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:09.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:09.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:09.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:10.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:10.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:10.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:10.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:11.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:11.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:11.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:11.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:12.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:12.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:12.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:12.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:13.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:13.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:13.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:13.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:14.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:14.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:14.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:14.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:15.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:15.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:15.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:15.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:16.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:16.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:16.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:16.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:17.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:17.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:17.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:17.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:18.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:18.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:18.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:18.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:19.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:19.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:19.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:19.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:20.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:20.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:20.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:20.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:21.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:21.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:21.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:21.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:22.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:22.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:22.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:22.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:23.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:23.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:23.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:23.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:24.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:24.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:24.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:24.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:25.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:25.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:25.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:25.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:26.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:26.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:26.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:26.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:27.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:27.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:27.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:27.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:28.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:28.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:28.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:28.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:29.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:29.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:29.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:29.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:30.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:30.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:30.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:30.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:31.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:31.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:31.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:31.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:32.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:32.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:32.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:32.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:33.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:33.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:33.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:33.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:34.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:34.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:34.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:34.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:35.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:35.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:35.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:35.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:36.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:36.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:36.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:36.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:37.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:37.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:37.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:37.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:38.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:38.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:38.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:38.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:39.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:39.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:39.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:39.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:40.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:40.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:40.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:40.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:41.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:41.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:41.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:41.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:42.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:42.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:42.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:42.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:43.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:43.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:43.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:43.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:44.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:44.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:44.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:44.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:45.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:45.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:45.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:45.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:46.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:46.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:46.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:46.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:47.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:47.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:47.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:47.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:48.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:48.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:48.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:48.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:49.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:49.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:49.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:49.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:50.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:50.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:50.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:50.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:51.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:51.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:51.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:51.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:52.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:52.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:52.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:52.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:53.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:53.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:53.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:53.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:54.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:54.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:54.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:54.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:55.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:55.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:55.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:55.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:56.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:56.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:56.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:56.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:57.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:57.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:57.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:57.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:58.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:58.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:58.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:58.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:59.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:15:59.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:15:59.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:15:59.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:00.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:00.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:00.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:00.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:01.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:01.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:01.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:01.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:02.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:02.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:02.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:02.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:03.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:03.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:03.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:03.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:04.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:04.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:04.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:04.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:05.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:05.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:05.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:05.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:06.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:06.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:06.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:06.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:07.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:07.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:07.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:07.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:08.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:08.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:08.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:08.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:09.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:09.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:09.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:09.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:10.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:10.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:10.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:10.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:11.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:11.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:11.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:11.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:12.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:12.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:12.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:12.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:13.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:13.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:13.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:13.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:14.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:14.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:14.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:14.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:15.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:15.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:15.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:15.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:16.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:16.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:16.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:16.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:17.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:17.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:17.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:17.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:18.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:18.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:18.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:18.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:19.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:19.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:19.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:19.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:20.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:20.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:20.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:20.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:21.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:21.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:21.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:21.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:22.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:22.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:22.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:22.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:23.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:23.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:23.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:23.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:24.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:24.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:24.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:24.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:25.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:25.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:25.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:25.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:26.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:26.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:26.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:26.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:27.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:27.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:27.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:27.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:28.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:28.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:28.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:28.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:29.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:29.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:29.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:29.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:30.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:30.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:30.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:30.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:31.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:31.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:31.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:31.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:32.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:32.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:32.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:32.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:33.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:33.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:33.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:33.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:34.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:34.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:34.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:34.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:35.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:35.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:35.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:35.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:36.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:36.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:36.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:36.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:37.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:37.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:37.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:37.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:38.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:38.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:38.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:38.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:39.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:39.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:39.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:39.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:40.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:40.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:40.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:40.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:41.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:41.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:41.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:41.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:42.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:42.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:42.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:42.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:43.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:43.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:43.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:43.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:44.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:44.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:44.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:44.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:45.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:45.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:45.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:45.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:46.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:46.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:46.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:46.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:47.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:47.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:47.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:47.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:48.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:48.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:48.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:48.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:49.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:49.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:49.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:49.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:50.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:50.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:50.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:50.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:51.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:51.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:51.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:51.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:52.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:52.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:52.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:52.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:53.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:53.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:53.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:53.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:54.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:54.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:54.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:54.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:55.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:55.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:55.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:55.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:56.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:56.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:56.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:56.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:57.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:57.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:57.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:57.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:58.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:58.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:58.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:58.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:59.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:16:59.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:16:59.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:16:59.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:00.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:00.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:00.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:00.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:01.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:01.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:01.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:01.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:02.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:02.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:02.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:02.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:03.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:03.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:03.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:03.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:04.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:04.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:04.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:04.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:05.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:05.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:05.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:05.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:06.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:06.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:06.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:06.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:07.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:07.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:07.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:07.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:08.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:08.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:08.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:08.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:09.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:09.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:09.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:09.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:10.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:10.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:10.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:10.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:11.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:11.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:11.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:11.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:12.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:12.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:12.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:12.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:13.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:13.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:13.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:13.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:14.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:14.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:14.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:14.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:15.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:15.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:15.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:15.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:16.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:16.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:16.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:16.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:17.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:17.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:17.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:17.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:18.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:18.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:18.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:18.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:19.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:19.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:19.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:19.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:20.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:20.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:20.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:20.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:21.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:21.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:21.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:21.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:22.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:22.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:22.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:22.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:23.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:23.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:23.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:23.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:24.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:24.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:24.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:24.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:25.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:25.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:25.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:25.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:26.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:26.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:26.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:26.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:27.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:27.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:27.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:27.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:28.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:28.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:28.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:28.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:29.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:29.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:29.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:29.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:30.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:30.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:30.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:30.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:31.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:31.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:31.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:31.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:32.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:32.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:32.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:32.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:33.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:33.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:33.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:33.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:34.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:34.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:34.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:34.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:35.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:35.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:35.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:35.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:36.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:36.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:36.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:36.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:37.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:37.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:37.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:37.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:38.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:38.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:38.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:38.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:39.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:39.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:39.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:39.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:40.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:40.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:40.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:40.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:41.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:41.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:41.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:41.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:42.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:42.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:42.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:42.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:43.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:43.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:43.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:43.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:44.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:44.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:44.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:44.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:45.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:45.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:45.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:45.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:46.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:46.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:46.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:46.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:47.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:47.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:47.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:47.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:48.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:48.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:48.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:48.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:49.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:49.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:49.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:49.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:50.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:50.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:50.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:50.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:51.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:51.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:51.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:51.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:52.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:52.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:52.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:52.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:53.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:53.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:53.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:53.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:54.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:54.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:54.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:54.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:55.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:55.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:55.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:55.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:56.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:56.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:56.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:56.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:57.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:57.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:57.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:57.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:58.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:58.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:58.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:58.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:59.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:17:59.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:17:59.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:17:59.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:00.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:00.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:00.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:00.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:01.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:01.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:01.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:01.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:02.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:02.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:02.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:02.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:03.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:03.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:03.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:03.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:04.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:04.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:04.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:04.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:05.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:05.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:05.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:05.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:06.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:06.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:06.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:06.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:07.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:07.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:07.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:07.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:08.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:08.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:08.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:08.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:09.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:09.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:09.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:09.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:10.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:10.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:10.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:10.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:11.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:11.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:11.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:11.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:12.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:12.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:12.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:12.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:13.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:13.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:13.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:13.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:14.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:14.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:14.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:14.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:15.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:15.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:15.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:15.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:16.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:16.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:16.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:16.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:17.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:17.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:17.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:17.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:18.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:18.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:18.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:18.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:19.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:19.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:19.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:19.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:20.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:20.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:20.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:20.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:21.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:21.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:21.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:21.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:22.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:22.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:22.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:22.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:23.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:23.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:23.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:23.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:24.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:24.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:24.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:24.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:25.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:25.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:25.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:25.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:26.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:26.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:26.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:26.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:27.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:27.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:27.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:27.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:28.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:28.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:28.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:28.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:29.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:29.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:29.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:29.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:30.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:30.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:30.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:30.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:31.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:31.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:31.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:31.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:32.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:32.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:32.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:32.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:33.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:33.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:33.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:33.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:34.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:34.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:34.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:34.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:35.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:35.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:35.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:35.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:36.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:36.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:36.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:36.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:37.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:37.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:37.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:37.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:38.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:38.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:38.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:38.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:39.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:39.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:39.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:39.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:40.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:40.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:40.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:40.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:41.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:41.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:41.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:41.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:42.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:42.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:42.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:42.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:43.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:43.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:43.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:43.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:44.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:44.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:44.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:44.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:45.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:45.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:45.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:45.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:46.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:46.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:46.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:46.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:47.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:47.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:47.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:47.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:48.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:48.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:48.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:48.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:49.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:49.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:49.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:49.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:50.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:50.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:50.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:50.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:51.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:51.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:51.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:51.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:52.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:52.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:52.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:52.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:53.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:53.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:53.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:53.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:54.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:54.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:54.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:54.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:55.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:55.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:55.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:55.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:56.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:56.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:57.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:57.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:57.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:57.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:58.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:58.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:58.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:58.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:59.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:18:59.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:18:59.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:18:59.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:00.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:00.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:00.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:00.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:01.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:01.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:01.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:01.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:02.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:02.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:02.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:02.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:03.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:03.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:03.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:03.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:04.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:04.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:04.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:04.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:05.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:05.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:05.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:05.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:06.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:06.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:06.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:06.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:07.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:07.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:07.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:07.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:08.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:08.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:08.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:08.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:09.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:09.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:09.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:09.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:10.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:10.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:10.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:10.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:11.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:11.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:11.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:11.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:12.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:12.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:12.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:12.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:13.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:13.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:13.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:13.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:14.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:14.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:14.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:14.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:15.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:15.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:15.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:15.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:16.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:16.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:16.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:16.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:17.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:17.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:17.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:17.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:18.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:18.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:18.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:18.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:19.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:19.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:19.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:19.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:20.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:20.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:20.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:20.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:21.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:21.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:21.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:21.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:21.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:21.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:22.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:22.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:23.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:23.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:23.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:23.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:24.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:24.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:24.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:25.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:24.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:25.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:25.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:26.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:25.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:26.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:26.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:27.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:27.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:27.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:27.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:28.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:28.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:28.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:28.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:29.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:28.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:29.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:29.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:29.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:29.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:30.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:30.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:31.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:31.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:31.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:31.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:32.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:32.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:32.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:32.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:33.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:33.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:33.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:33.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:33.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:33.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:34.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:34.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:35.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:35.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:35.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:35.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:36.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:36.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:36.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:36.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:36.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:36.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:37.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:37.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:37.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:37.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:38.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:38.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:39.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:38.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:39.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:39.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:39.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:39.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:40.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:40.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:41.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:40.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:41.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:41.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:41.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:41.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:42.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:42.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:43.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:43.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:43.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:43.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:44.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:44.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:44.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:44.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:45.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:45.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:45.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:45.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:46.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:46.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:46.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:46.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:47.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:47.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:47.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:47.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:48.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:48.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:48.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:49.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:49.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:49.587 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T01:19:49.584+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa8008740 msgr2=0x7f5fa4032ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T01:19:49.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:49.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:50.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:50.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:50.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:50.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:51.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:51.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:51.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:51.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:52.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:52.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:52.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:52.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:53.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:53.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:53.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:53.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:54.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:54.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:54.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:54.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:55.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:55.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:55.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:55.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:56.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:56.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:56.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:56.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:57.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:57.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:57.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:57.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:58.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:58.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:58.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:58.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:59.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:19:59.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:19:59.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:19:59.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:00.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:00.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:00.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:00.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:01.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:01.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:01.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:01.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:02.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:02.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:02.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:02.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:03.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:03.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:03.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:03.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:04.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:04.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:04.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:04.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:05.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:05.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:05.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:05.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:06.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:06.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:06.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:06.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:06.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:06.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:07.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:07.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:08.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:08.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:08.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:08.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:09.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:09.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:09.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:09.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:10.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:10.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:10.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:10.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:11.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:11.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:11.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:11.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:12.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:12.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:12.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:12.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:13.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:13.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:14.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:13.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:14.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:14.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:15.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:15.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:15.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:15.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:16.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:16.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:16.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:16.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:17.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:17.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:17.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:17.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:18.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:18.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:18.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:18.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:19.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:19.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:19.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:19.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:19.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:19.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:20.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:20.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:20.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:20.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:21.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:21.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:22.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:21.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:22.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:22.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:23.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:23.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:23.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:23.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:23.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:23.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:24.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:24.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:24.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:24.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:25.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:25.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:26.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:25.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:26.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:26.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:26.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:26.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:27.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:27.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:27.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:27.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:28.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:28.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:28.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:28.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:29.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:29.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:29.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:29.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:30.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:30.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:30.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:30.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:31.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:31.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:31.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:31.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:32.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:32.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:32.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:32.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:33.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:33.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:33.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:33.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:34.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:34.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:34.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:34.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:35.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:35.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:35.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:35.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:36.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:36.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:36.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:36.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:37.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:37.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:37.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:37.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:38.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:38.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:38.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:38.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:39.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:39.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:39.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:39.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:40.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:40.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:40.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:40.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:41.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:41.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:41.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:41.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:42.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:42.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:42.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:42.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:43.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:43.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:43.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:43.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:44.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:44.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:44.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:44.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:45.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:45.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:45.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:45.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:46.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:46.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:46.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:46.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:47.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:47.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:47.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:47.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:48.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:48.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:48.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:48.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:49.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:49.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:49.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:49.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:50.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:50.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:50.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:50.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:51.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:51.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:51.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:51.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:52.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:52.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:52.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:52.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:53.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:53.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:53.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:53.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:54.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:54.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:54.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:54.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:55.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:55.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:55.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:55.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:56.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:56.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:56.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:56.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:57.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:57.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:57.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:57.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:58.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:58.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:58.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:58.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:59.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:20:59.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:20:59.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:20:59.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:00.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:00.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:00.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:00.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:01.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:01.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:02.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:02.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:02.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:02.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:03.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:03.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:03.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:03.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:04.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:04.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:04.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:04.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:05.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:04.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:05.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:05.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:06.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:06.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:06.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:06.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:06.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:06.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:07.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:07.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:07.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:07.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:08.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:08.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:08.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:08.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:09.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:09.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:09.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:09.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:10.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:10.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:10.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:10.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:11.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:11.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:12.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:12.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:12.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:12.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:13.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:13.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:13.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:13.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:14.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:14.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:14.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:14.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:15.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:15.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:15.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:15.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:16.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:16.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:16.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:16.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:17.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:17.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:17.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:17.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:18.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:18.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:18.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:18.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:19.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:18.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:19.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:19.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:20.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:19.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:20.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:20.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:20.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:20.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:21.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:21.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:21.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:21.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:22.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:22.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:23.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:23.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:23.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:23.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:23.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:23.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:24.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:24.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:24.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:24.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:25.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:25.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:26.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:26.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:26.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:26.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:27.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:27.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:27.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:27.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:28.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:28.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:28.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:28.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:29.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:29.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:29.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:29.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:30.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:30.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:30.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:30.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:31.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:31.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:31.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:31.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:32.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:32.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:32.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:32.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:33.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:33.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:33.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:33.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:34.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:34.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:34.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:34.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:35.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:35.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:35.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:35.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:36.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:36.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:36.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:36.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:37.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:37.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:37.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:37.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:38.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:38.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:38.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:38.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:38.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:38.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:39.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:39.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:39.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:39.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:40.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:40.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:40.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:40.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:41.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:41.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:41.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:41.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:42.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:42.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:42.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:42.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:43.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:43.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:43.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:43.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:44.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:44.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:44.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:44.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:45.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:45.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:45.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:45.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:46.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:46.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:46.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:46.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:47.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:47.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:48.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:48.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:48.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:48.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:49.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:49.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:49.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:49.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:50.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:50.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:50.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:50.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:51.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:51.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:51.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:51.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:52.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:52.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:52.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:52.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:53.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:53.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:53.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:53.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:54.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:54.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:54.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:54.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:55.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:55.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:55.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:55.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:56.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:56.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:56.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:56.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:57.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:57.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:57.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:57.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:58.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:58.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:58.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:58.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:59.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:21:59.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:21:59.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:21:59.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:00.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:00.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:00.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:00.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:01.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:01.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:01.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:01.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:02.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:02.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:02.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:02.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:03.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:03.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:03.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:03.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:03.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:03.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:04.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:04.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:04.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:04.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:05.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:05.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:06.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:06.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:06.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:06.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:07.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:07.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:07.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:07.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:08.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:08.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:08.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:08.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:08.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:08.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:09.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:09.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:09.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:09.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:10.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:10.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:10.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:10.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:11.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:11.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:11.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:11.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:12.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:12.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:12.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:12.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:13.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:13.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:14.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:14.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:14.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:14.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:15.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:15.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:15.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:15.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:16.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:16.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:16.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:16.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:17.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:17.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:17.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:17.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:18.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:18.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:18.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:18.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:18.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:18.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:19.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:19.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:19.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:19.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:20.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:20.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:20.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:20.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:21.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:21.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:21.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:21.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:22.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:22.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:22.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:22.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:23.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:23.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:23.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:23.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:24.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:24.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:24.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:24.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:25.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:25.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:25.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:25.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:26.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:26.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:26.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:26.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:27.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:27.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:27.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:27.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:28.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:28.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:28.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:28.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:29.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:29.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:29.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:29.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:30.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:30.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:30.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:30.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:31.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:31.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:31.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:31.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:32.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:32.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:32.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:32.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:33.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:33.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:33.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:33.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:34.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:34.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:34.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:34.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:35.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:35.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:35.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:35.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:36.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:36.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:36.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:36.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:37.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:37.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:38.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:37.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:38.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:38.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:38.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:38.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:39.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:39.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:39.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:39.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:40.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:40.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:40.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:40.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:41.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:41.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:41.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:41.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:42.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:42.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:42.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:42.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:43.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:43.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:43.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:43.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:44.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:44.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:44.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:44.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:45.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:45.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:45.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:45.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:46.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:46.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:46.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:46.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:47.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:47.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:47.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:47.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:48.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:48.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:48.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:48.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:49.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:49.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:49.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:49.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:50.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:50.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:50.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:50.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:51.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:51.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:51.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:51.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:52.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:52.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:52.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:52.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:53.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:53.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:53.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:53.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:54.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:54.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:54.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:54.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:55.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:55.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:55.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:55.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:56.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:56.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:56.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:56.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:57.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:57.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:57.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:57.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:58.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:58.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:58.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:58.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:59.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:22:59.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:22:59.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:22:59.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:00.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:00.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:00.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:00.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:01.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:01.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:01.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:01.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:02.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:02.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:02.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:02.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:03.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:03.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:03.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:03.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:04.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:04.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:04.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:04.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:05.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:05.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:05.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:05.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:06.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:06.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:06.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:06.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:07.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:07.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:07.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:07.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:08.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:08.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:08.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:08.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:09.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:09.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:09.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:09.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:10.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:10.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:10.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:10.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:11.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:11.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:11.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:11.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:12.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:12.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:12.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:12.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:13.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:13.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:13.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:13.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:14.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:14.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:14.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:14.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:15.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:15.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:15.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:15.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:16.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:16.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:16.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:16.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:17.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:17.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:17.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:17.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:18.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:18.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:18.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:18.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:19.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:19.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:19.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:19.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:20.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:20.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:20.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:20.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:21.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:21.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:21.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:21.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:22.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:22.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:22.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:22.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:23.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:23.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:23.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:23.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:24.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:24.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:24.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:24.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:25.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:25.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:25.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:25.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:26.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:26.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:26.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:26.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:27.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:27.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:27.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:27.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:28.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:28.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:28.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:28.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:29.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:29.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:29.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:29.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:30.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:30.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:30.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:30.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:31.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:31.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:31.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:31.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:32.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:32.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:32.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:32.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:33.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:33.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:33.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:33.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:34.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:34.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:34.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:34.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:35.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:35.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:35.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:35.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:36.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:36.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:36.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:36.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:37.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:37.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:37.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:37.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:38.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:38.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:38.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:38.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:39.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:39.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:39.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:39.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:40.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:40.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:40.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:40.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:41.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:41.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:41.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:41.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:42.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:42.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:42.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:42.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:43.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:43.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:43.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:43.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:44.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:44.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:44.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:44.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:45.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:45.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:45.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:45.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:46.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:46.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:46.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:46.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:47.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:47.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:47.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:47.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:48.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:48.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:48.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:48.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:49.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:49.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:49.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:49.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:50.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:50.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:50.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:50.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:51.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:51.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:51.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:51.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:52.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:52.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:52.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:52.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:53.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:53.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:53.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:53.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:54.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:54.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:54.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:54.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:55.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:55.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:55.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:55.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:56.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:56.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:56.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:56.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:57.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:57.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:57.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:57.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:58.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:58.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:58.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:58.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:59.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:23:59.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:23:59.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:23:59.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:00.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:00.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:00.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:00.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:01.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:01.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:01.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:01.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:02.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:02.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:02.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:02.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:03.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:03.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:04.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:04.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:04.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:04.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:05.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:05.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:05.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:05.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:06.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:06.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:06.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:06.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:07.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:07.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:07.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:07.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:08.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:08.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:08.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:08.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:09.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:09.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:09.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:09.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:10.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:10.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:10.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:10.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:11.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:11.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:11.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:11.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:12.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:12.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:12.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:12.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:13.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:13.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:13.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:13.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:14.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:14.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:14.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:14.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:15.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:15.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:15.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:15.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:16.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:16.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:16.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:16.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:17.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:17.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:17.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:17.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:18.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:18.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:18.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:18.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:19.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:19.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:19.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:19.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:20.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:20.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:20.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:20.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:21.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:21.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:21.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:21.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:22.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:22.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:22.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:22.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:23.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:23.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:23.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:23.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:24.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:24.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:24.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:24.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:25.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:25.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:25.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:25.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:26.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:26.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:26.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:26.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:27.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:27.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:27.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:27.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:28.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:28.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:28.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:28.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:29.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:29.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:29.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:29.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:30.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:30.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:30.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:30.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:31.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:31.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:31.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:31.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:32.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:32.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:32.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:32.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:33.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:33.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:33.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:33.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:34.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:34.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:34.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:34.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:35.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:35.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:35.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:35.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:36.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:36.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:36.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:36.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:37.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:37.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:37.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:37.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:38.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:38.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:38.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:38.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:39.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:39.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:39.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:39.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:40.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:40.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:40.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:40.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:41.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:41.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:41.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:41.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:42.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:42.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:42.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:42.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:43.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:43.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:43.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:43.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:44.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:44.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:44.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:44.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:45.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:45.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:45.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:45.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:46.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:46.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:46.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:46.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:47.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:47.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:47.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:47.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:48.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:48.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:48.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:48.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:49.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:49.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:49.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:49.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:50.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:50.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:50.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:50.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:51.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:51.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:51.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:51.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:52.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:52.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:52.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:52.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:53.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:53.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:53.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:53.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:54.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:54.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:54.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:54.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:55.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:55.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:55.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:55.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:56.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:56.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:56.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:56.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:57.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:57.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:57.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:57.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:58.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:58.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:58.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:58.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:59.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:24:59.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:24:59.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:24:59.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:00.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:00.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:00.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:00.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:01.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:01.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:01.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:01.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:02.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:02.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:02.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:02.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:03.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:03.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:03.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:03.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:04.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:04.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:04.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:04.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:05.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:05.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:05.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:05.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:06.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:06.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:06.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:06.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:07.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:07.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:07.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:07.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:08.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:08.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:08.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:08.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:09.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:09.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:09.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:09.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:10.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:10.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:10.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:10.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:11.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:11.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:11.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:11.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:12.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:12.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:12.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:12.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:13.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:13.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:13.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:13.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:14.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:14.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:14.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:14.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:15.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:15.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:15.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:15.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:16.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:16.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:16.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:16.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:17.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:17.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:17.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:17.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:18.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:18.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:18.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:18.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:19.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:19.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:19.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:19.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:20.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:20.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:20.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:20.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:21.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:21.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:21.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:21.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:22.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:22.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:22.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:22.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:23.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:23.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:23.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:23.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:24.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:24.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:24.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:24.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:25.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:25.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:25.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:25.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:26.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:26.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:26.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:26.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:27.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:27.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:27.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:27.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:28.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:28.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:28.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:28.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:29.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:29.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:29.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:29.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:30.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:30.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:30.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:30.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:31.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:31.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:31.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:31.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:32.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:32.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:32.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:32.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:33.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:33.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:33.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:33.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:34.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:34.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:34.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:34.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:35.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:35.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:35.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:35.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:36.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:36.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:36.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:36.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:37.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:37.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:37.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:37.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:38.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:38.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:38.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:38.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:39.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:39.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:39.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:39.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:40.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:40.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:40.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:40.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:41.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:41.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:41.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:41.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:42.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:42.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:42.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:42.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:43.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:43.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:43.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:43.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:44.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:44.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:44.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:44.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:45.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:45.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:45.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:45.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:46.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:46.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:46.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:46.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:47.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:47.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:47.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:47.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:48.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:48.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:48.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:48.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:49.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:49.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:49.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:49.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:50.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:50.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:50.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:50.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:51.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:51.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:51.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:51.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:52.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:52.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:52.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:52.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:53.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:53.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:53.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:53.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:54.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:54.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:54.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:54.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:55.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:55.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:55.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:55.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:56.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:56.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:56.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:56.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:57.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:57.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:57.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:57.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:58.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:58.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:58.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:58.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:59.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:25:59.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:25:59.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:25:59.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:00.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:00.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:00.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:00.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:01.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:01.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:01.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:01.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:02.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:02.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:02.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:02.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:03.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:03.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:03.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:03.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:04.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:04.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:04.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:04.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:05.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:05.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:05.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:05.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:06.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:06.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:06.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:06.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:07.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:07.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:07.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:07.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:08.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:08.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:08.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:08.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:09.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:09.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:09.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:09.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:10.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:10.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:11.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:11.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:11.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:11.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:12.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:12.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:12.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:12.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:13.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:13.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:13.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:13.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:14.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:14.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:14.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:14.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:15.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:15.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:15.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:15.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:16.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:16.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:16.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:16.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:17.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:17.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:17.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:17.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:18.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:18.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:18.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:18.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:18.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:18.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:19.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:19.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:19.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:19.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:20.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:20.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:21.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:21.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:21.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:21.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:21.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:21.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:22.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:22.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:22.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:22.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:23.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:23.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:23.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:23.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:24.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:24.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:25.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:24.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:25.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:25.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:25.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:25.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:26.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:26.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:27.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:27.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:27.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:27.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:27.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:27.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:28.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:28.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:29.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:28.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:29.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:29.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:30.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:29.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:30.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:30.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:31.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:31.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:31.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:31.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:31.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:31.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:32.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:32.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:33.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:32.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:33.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:33.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:34.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:33.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:34.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:34.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:35.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:35.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:35.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:35.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:36.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:36.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:36.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:36.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:37.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:37.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:37.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:37.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:38.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:38.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:38.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:38.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:39.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:39.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:39.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:39.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:40.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:40.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:40.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:40.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:41.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:41.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:41.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:41.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:42.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:42.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:42.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:42.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:43.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:43.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:43.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:43.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:44.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:44.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:44.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:44.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:45.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:45.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:45.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:45.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:46.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:46.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:46.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:46.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:47.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:47.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:47.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:47.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:48.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:48.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:48.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:48.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:49.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:49.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:49.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:49.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:50.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:50.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:50.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:50.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:51.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:51.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:51.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:51.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:52.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:52.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:52.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:52.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:53.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:53.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:53.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:53.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:54.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:54.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:54.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:54.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:55.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:55.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:55.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:55.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:56.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:56.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:56.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:56.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:57.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:57.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:57.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:57.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:58.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:58.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:58.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:58.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:59.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:26:59.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:26:59.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:26:59.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:00.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:00.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:00.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:00.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:01.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:01.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:01.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:01.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:02.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:02.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:02.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:02.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:03.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:03.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:03.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:03.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:04.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:04.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:04.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:04.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:05.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:05.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:05.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:05.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:06.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:06.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:06.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:06.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:07.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:07.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:07.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:07.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:08.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:08.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:08.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:08.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:09.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:09.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:09.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:09.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:10.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:10.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:10.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:10.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:11.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:11.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:11.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:11.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:12.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:12.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:12.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:12.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:13.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:13.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:13.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:13.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:14.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:14.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:14.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:14.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:15.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:15.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:15.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:15.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:16.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:16.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:16.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:16.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:17.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:17.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:17.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:17.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:17.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:17.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:18.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:18.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:19.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:19.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:19.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:19.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:20.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:20.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:20.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:20.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:21.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:21.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:21.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:21.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:22.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:22.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:22.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:22.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:23.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:23.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:23.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:23.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:23.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:23.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:24.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:24.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:24.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:24.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:25.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:25.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:26.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:25.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:26.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:26.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:26.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:26.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:27.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:27.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:27.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:27.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:28.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:28.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:28.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:28.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:29.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:29.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:29.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:29.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:30.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:30.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:30.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:30.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:31.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:31.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:31.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:31.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:32.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:32.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:32.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:32.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:33.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:33.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:33.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:33.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:34.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:34.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:34.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:34.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:35.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:35.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:35.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:35.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:36.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:36.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:36.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:36.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:37.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:37.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:37.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:37.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:38.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:38.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:38.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:38.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:39.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:39.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:39.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:39.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:40.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:40.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:40.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:40.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:41.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:41.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:41.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:41.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:42.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:42.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:42.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:42.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:43.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:43.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:44.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:44.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:44.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:44.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:45.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:45.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:45.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:45.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:46.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:46.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:46.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:46.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:47.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:47.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:47.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:47.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:48.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:48.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:48.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:48.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:49.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:49.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:49.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:49.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:50.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:50.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:50.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:50.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:51.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:51.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:51.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:51.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:52.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:52.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:52.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:52.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:53.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:53.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:53.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:53.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:54.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:54.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:54.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:54.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:55.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:55.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:55.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:55.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:56.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:56.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:56.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:56.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:57.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:57.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:57.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:57.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:58.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:58.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:58.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:58.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:59.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:27:59.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:27:59.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:27:59.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:00.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:00.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:00.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:00.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:01.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:01.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:01.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:01.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:02.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:02.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:02.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:02.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:03.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:03.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:03.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:03.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:04.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:04.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:04.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:04.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:05.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:05.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:05.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:05.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:06.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:06.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:06.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:06.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:07.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:07.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:07.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:07.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:08.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:08.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:08.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:08.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:09.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:09.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:09.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:09.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:10.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:10.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:10.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:10.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:11.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:11.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:11.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:11.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:12.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:12.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:12.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:12.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:13.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:13.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:13.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:13.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:14.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:14.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:14.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:14.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:15.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:15.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:15.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:15.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:16.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:16.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:16.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:16.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:17.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:17.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:17.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:18.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:18.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:18.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:18.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:19.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:19.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:19.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:19.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:20.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:20.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:20.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:20.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:21.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:21.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:21.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:21.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:22.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:22.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:22.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:22.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:23.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:23.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:23.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:23.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:24.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:24.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:24.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:24.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:25.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:25.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:25.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:25.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:26.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:26.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:26.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:26.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:27.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:27.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:27.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:27.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:28.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:28.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:28.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:28.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:29.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:29.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:29.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:29.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:30.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:30.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:30.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:30.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:31.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:31.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:31.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:31.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:32.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:32.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:32.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:32.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:33.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:33.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:33.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:33.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:34.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:34.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:34.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:34.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:35.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:35.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:35.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:35.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:36.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:36.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:36.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:36.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:37.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:37.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:37.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:37.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:38.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:38.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:38.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:38.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:39.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:39.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:39.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:39.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:40.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:40.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:40.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:40.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:41.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:41.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:41.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:41.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:42.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:42.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:42.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:42.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:43.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:43.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:43.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:43.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:44.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:44.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:44.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:44.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:45.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:45.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:45.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:45.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:46.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:46.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:46.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:46.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:47.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:47.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:47.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:47.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:48.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:48.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:48.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:48.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:49.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:48.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:49.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:49.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:50.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:50.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:50.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:50.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:51.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:51.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:51.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:51.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:52.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:52.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:52.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:52.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:53.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:53.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:53.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:53.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:54.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:54.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:54.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:54.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:55.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:55.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:55.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:55.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:56.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:56.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:56.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:56.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:57.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:57.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:57.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:57.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:58.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:58.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:58.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:58.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:59.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:28:59.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:28:59.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:28:59.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:00.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:00.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:00.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:00.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:01.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:01.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:01.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:01.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:02.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:02.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:02.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:02.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:03.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:03.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:03.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:03.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:04.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:04.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:04.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:04.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:05.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:05.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:05.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:05.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:06.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:06.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:06.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:06.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:07.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:07.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:07.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:07.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:08.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:08.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:08.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:08.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:09.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:09.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:09.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:09.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:10.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:10.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:10.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:10.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:11.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:11.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:11.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:11.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:12.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:12.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:12.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:12.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:13.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:13.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:13.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:13.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:14.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:14.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:14.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:14.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:15.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:15.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:15.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:15.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:16.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:16.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:16.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:16.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:17.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:17.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:17.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:17.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:18.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:18.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:18.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:18.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:19.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:19.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:19.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:19.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:20.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:20.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:20.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:20.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:21.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:21.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:21.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:21.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:22.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:22.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:22.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:22.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:23.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:23.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:23.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:23.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:24.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:24.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:24.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:24.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:25.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:25.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:25.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:25.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:26.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:26.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:26.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:26.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:27.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:27.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:27.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:27.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:28.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:28.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:28.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:28.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:29.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:29.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:29.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:29.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:30.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:30.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:30.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:30.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:31.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:31.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:31.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:31.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:32.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:32.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:32.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:32.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:33.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:33.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:33.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:34.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:34.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:34.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:34.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:35.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:35.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:35.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:35.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:36.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:36.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:36.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:36.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:37.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:37.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:37.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:37.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:38.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:38.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:38.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:38.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:39.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:39.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:39.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:39.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:40.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:40.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:40.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:40.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:41.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:41.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:41.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:41.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:42.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:42.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:42.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:42.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:43.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:43.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:43.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:43.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:44.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:44.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:44.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:44.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:45.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:45.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:45.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:45.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:46.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:46.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:46.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:46.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:47.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:47.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:47.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:47.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:48.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:48.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:48.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:48.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:49.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:49.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:49.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:49.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:50.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:50.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:50.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:50.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:51.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:51.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:51.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:51.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:52.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:52.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:52.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:52.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:53.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:53.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:53.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:53.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:54.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:54.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:54.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:54.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:55.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:55.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:55.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:55.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:56.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:56.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:56.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:56.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:57.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:57.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:57.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:57.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:58.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:58.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:58.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:58.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:59.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:29:59.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:29:59.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:29:59.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:00.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:00.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:00.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:00.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:01.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:01.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:01.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:01.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:02.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:02.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:02.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:02.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:03.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:03.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:03.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:03.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:04.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:04.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:04.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:04.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:05.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:05.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:05.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:05.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:06.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:06.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:06.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:06.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:07.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:07.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:07.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:07.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:08.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:08.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:08.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:08.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:09.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:09.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:09.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:09.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:10.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:10.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:10.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:10.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:11.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:11.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:11.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:11.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:12.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:12.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:12.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:12.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:13.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:13.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:13.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:13.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:14.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:14.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:14.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:14.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:15.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:15.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:15.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:15.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:16.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:16.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:16.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:16.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:17.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:17.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:17.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:17.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:18.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:18.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:18.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:18.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:19.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:19.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:19.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:19.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:20.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:20.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:20.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:20.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:21.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:21.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:21.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:21.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:22.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:22.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:22.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:22.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:23.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:23.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:23.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:23.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:24.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:24.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:24.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:24.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:25.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:25.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:25.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:25.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:26.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:26.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:26.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:26.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:27.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:27.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:27.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:27.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:28.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:28.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:28.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:28.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:29.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:29.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:29.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:29.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:30.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:30.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:30.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:30.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:31.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:31.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:31.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:31.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:32.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:32.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:32.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:32.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:33.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:33.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:33.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:33.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:34.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:34.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:34.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:34.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:35.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:35.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:35.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:35.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:36.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:36.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:36.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:36.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:37.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:37.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:37.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:37.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:38.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:38.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:38.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:39.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:39.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:39.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:39.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:40.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:40.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:40.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:40.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:41.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:41.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:41.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:41.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:42.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:42.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:42.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:42.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:43.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:43.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:43.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:43.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:44.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:44.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:44.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:44.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:45.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:45.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:45.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:45.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:46.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:46.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:46.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:46.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:47.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:47.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:47.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:47.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:48.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:48.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:48.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:48.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:49.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:49.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:49.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:49.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:50.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:50.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:50.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:50.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:51.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:51.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:51.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:51.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:52.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:52.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:52.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:52.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:53.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:53.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:53.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:53.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:54.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:54.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:54.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:54.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:55.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:55.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:55.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:55.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:56.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:56.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:56.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:56.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:57.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:57.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:57.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:57.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:58.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:58.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:58.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:58.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:59.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:30:59.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:30:59.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:30:59.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:00.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:00.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:00.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:00.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:01.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:01.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:01.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:01.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:02.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:02.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:02.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:02.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:03.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:03.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:03.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:03.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:04.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:04.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:04.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:04.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:05.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:05.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:05.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:05.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:06.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:06.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:06.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:06.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:07.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:07.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:07.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:07.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:07.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:07.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:08.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:08.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:08.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:08.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:09.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:09.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:09.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:09.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:10.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:10.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:10.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:10.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:11.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:11.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:11.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:11.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:12.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:12.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:12.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:12.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:13.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:13.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:13.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:13.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:14.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:14.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:14.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:14.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:15.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:15.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:15.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:15.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:16.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:16.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:16.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:16.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:17.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:17.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:17.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:17.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:18.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:18.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:18.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:18.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:19.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:19.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:19.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:19.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:20.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:20.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:20.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:20.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:21.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:21.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:21.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:21.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:22.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:22.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:22.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:22.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:23.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:23.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:23.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:23.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:24.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:24.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:24.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:24.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:25.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:25.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:25.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:25.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:26.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:26.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:26.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:26.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:27.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:27.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:27.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:27.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:28.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:28.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:28.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:28.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:29.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:29.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:29.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:29.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:30.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:30.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:30.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:30.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:31.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:31.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:31.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:31.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:32.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:32.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:32.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:32.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:33.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:33.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:33.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:33.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:34.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:34.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:34.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:34.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:35.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:35.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:35.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:35.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:36.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:36.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:36.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:36.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:37.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:37.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:37.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:37.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:38.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:38.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:38.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:39.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:39.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:39.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:39.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:40.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:40.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:40.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:40.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:41.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:41.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:41.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:41.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:42.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:42.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:42.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:42.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:43.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:43.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:43.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:43.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:44.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:44.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:44.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:44.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:45.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:45.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:45.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:45.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:46.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:46.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:46.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:46.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:47.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:47.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:47.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:47.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:48.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:48.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:48.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:48.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:49.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:49.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:49.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:49.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:50.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:50.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:50.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:50.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:51.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:51.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:51.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:51.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:52.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:52.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:52.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:52.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:53.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:53.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:53.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:53.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:54.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:54.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:54.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:54.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:55.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:55.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:55.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:55.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:56.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:56.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:56.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:56.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:57.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:57.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:57.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:57.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:58.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:58.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:58.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:58.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:59.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:31:59.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:31:59.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:31:59.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:00.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:00.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:00.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:00.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:01.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:01.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:01.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:01.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:02.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:02.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:02.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:02.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:03.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:03.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:03.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:03.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:04.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:04.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:04.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:04.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:05.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:05.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:05.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:05.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:06.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:06.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:07.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:07.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:07.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:07.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:08.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:08.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:08.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:08.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:09.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:09.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:09.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:09.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:10.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:10.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:10.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:10.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:11.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:11.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:11.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:11.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:12.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:12.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:12.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:12.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:13.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:13.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:13.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:13.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:14.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:14.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:14.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:14.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:15.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:15.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:15.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:15.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:16.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:16.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:16.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:16.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:16.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:16.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:17.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:17.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:18.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:18.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:18.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:18.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:19.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:19.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:19.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:19.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:20.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:20.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:20.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:20.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:21.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:21.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:21.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:21.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:22.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:22.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:22.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:22.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:23.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:23.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:23.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:23.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:24.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:24.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:24.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:24.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:25.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:25.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:25.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:25.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:26.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:26.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:26.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:26.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:27.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:27.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:27.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:27.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:28.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:28.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:28.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:28.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:29.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:29.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:29.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:29.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:30.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:30.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:30.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:30.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:31.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:31.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:31.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:31.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:32.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:32.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:32.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:32.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:33.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:33.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:33.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:33.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:34.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:34.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:34.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:34.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:35.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:35.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:35.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:35.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:36.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:36.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:36.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:36.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:37.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:37.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:37.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:37.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:38.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:38.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:38.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:38.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:39.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:39.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:39.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:39.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:40.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:40.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:40.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:40.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:41.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:41.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:41.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:41.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:42.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:42.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:42.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:42.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:43.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:43.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:43.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:43.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:44.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:44.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:44.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:44.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:45.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:45.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:45.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:45.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:46.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:46.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:46.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:46.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:47.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:47.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:47.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:47.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:48.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:48.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:48.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:48.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:49.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:49.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:49.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:49.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:50.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:50.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:50.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:50.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:51.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:51.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:51.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:51.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:52.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:52.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:52.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:52.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:53.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:53.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:53.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:53.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:54.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:54.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:54.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:54.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:55.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:55.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:55.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:55.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:56.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:56.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:56.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:56.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:57.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:57.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:57.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:57.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:58.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:58.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:58.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:58.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:59.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:32:59.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:32:59.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:32:59.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:00.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:00.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:00.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:00.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:01.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:01.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:01.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:01.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:02.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:02.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:02.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:02.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:03.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:03.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:03.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:03.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:04.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:04.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:04.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:04.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:05.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:05.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:05.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:05.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:06.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:06.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:06.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:06.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:07.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:07.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:07.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:07.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:08.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:08.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:08.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:08.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:09.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:09.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:09.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:09.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:10.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:10.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:10.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:10.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:11.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:11.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:11.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:11.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:12.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:12.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:12.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:12.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:13.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:13.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:13.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:13.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:14.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:14.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:14.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:14.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:15.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:15.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:15.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:15.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:16.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:16.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:16.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:16.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:17.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:17.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:17.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:17.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:18.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:18.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:18.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:18.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:19.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:19.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:19.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:19.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:20.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:20.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:20.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:20.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:21.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:21.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:21.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:21.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:22.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:22.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:22.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:22.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:23.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:23.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:23.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:23.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:24.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:24.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:24.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:24.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:25.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:25.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:25.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:25.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:26.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:26.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:26.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:26.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:27.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:27.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:27.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:27.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:28.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:28.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:28.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:28.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:29.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:29.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:29.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:29.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:30.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:30.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:30.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:30.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:31.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:31.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:31.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:31.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:32.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:32.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:32.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:32.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:33.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:33.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:33.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:33.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:34.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:34.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:34.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:34.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:35.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:35.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:35.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:35.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:36.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:36.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:36.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:36.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:37.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:37.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:37.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:37.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:38.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:38.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:38.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:38.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:39.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:39.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:39.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:39.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:40.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:40.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:40.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:40.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:41.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:41.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:41.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:41.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:42.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:42.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:42.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:42.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:43.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:43.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:43.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:43.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:44.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:44.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:44.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:44.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:45.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:45.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:46.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:46.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:46.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:46.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:47.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:47.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:47.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:47.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:48.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:48.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:48.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:48.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:49.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:49.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:49.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:49.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:50.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:50.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:50.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:50.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:51.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:51.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:51.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:51.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:52.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:52.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:52.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:52.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:53.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:53.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:53.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:53.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:54.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:54.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:54.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:54.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:55.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:55.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:55.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:55.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:56.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:56.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:56.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:56.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:57.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:57.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:57.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:57.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:58.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:58.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:58.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:58.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:59.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:33:59.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:33:59.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:33:59.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:00.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:00.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:00.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:00.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:01.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:01.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:01.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:01.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:02.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:02.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:02.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:02.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:03.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:03.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:03.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:03.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:04.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:04.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:04.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:04.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:04.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:04.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:05.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:05.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:05.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:05.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:06.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:06.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:06.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:06.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:07.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:07.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:07.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:07.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:08.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:08.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:08.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:08.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:09.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:09.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:09.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:09.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:10.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:10.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:10.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:10.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:11.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:11.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:11.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:11.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:12.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:12.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:12.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:12.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:13.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:13.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:13.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:13.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:14.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:14.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:14.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:14.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:15.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:15.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:15.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:15.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:16.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:16.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:16.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:16.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:17.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:17.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:17.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:17.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:18.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:18.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:18.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:18.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:19.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:19.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:19.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:19.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:20.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:20.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:20.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:20.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:21.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:21.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:21.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:21.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:22.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:22.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:22.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:22.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:23.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:23.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:23.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:23.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:24.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:24.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:24.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:24.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:25.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:25.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:25.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:25.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:26.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:26.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:26.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:26.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:27.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:27.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:27.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:27.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:28.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:28.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:28.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:28.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:29.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:29.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:29.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:29.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:30.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:30.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:30.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:30.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:31.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:31.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:31.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:31.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:32.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:32.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:32.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:32.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:33.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:33.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:33.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:33.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:34.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:34.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:34.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:34.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:35.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:35.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:35.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:35.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:36.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:36.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:36.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:36.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:37.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:37.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:37.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:37.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:38.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:38.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:38.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:38.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:39.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:39.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:39.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:39.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:40.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:40.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:40.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:40.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:41.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:41.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:41.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:41.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:42.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:42.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:42.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:42.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:43.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:43.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:43.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:43.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:44.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:44.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:44.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:44.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:45.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:45.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:45.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:45.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:46.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:46.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:46.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:46.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:47.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:47.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:47.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:47.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:48.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:48.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:48.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:48.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:49.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:49.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:49.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:49.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:50.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:50.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:50.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:50.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:51.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:51.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:51.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:51.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:52.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:52.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:52.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:52.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:53.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:53.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:53.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:53.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:54.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:54.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:54.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:54.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:55.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:55.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:55.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:55.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:56.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:56.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:56.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:56.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:57.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:57.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:57.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:57.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:58.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:58.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:58.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:58.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:59.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:34:59.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:34:59.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:34:59.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:00.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:00.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:00.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:00.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:01.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:01.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:01.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:01.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:02.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:02.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:02.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:02.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:03.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:03.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:03.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:03.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:04.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:04.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:04.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:04.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:05.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:05.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:05.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:05.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:06.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:06.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:07.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:06.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:07.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:07.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:08.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:08.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:08.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:08.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:09.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:09.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:09.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:09.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:10.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:10.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:10.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:10.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:11.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:11.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:11.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:11.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:12.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:12.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:12.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:12.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:13.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:13.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:13.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:13.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:14.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:14.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:14.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:14.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:15.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:15.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:15.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:15.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:16.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:16.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:16.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:16.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:17.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:17.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:17.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:17.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:18.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:18.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:18.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:19.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:19.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:19.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:19.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:20.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:20.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:20.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:20.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:21.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:21.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:21.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:21.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:22.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:22.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:22.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:22.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:23.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:23.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:23.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:23.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:24.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:24.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:24.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:24.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:25.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:25.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:25.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:25.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:26.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:26.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:26.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:26.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:27.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:27.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:27.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:27.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:28.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:28.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:28.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:28.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:29.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:29.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:29.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:29.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:30.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:30.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:30.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:30.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:31.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:31.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:31.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:31.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:32.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:32.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:32.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:32.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:33.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:33.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:33.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:33.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:34.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:34.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:34.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:34.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:35.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:35.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:35.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:35.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:36.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:36.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:36.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:36.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:37.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:37.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:37.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:37.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:38.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:38.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:38.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:38.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:39.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:39.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:39.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:39.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:40.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:40.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:40.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:40.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:41.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:41.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:41.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:41.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:42.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:42.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:42.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:42.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:43.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:43.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:43.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:43.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:44.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:44.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:44.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:44.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:45.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:45.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:45.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:45.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:46.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:46.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:46.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:46.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:47.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:47.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:47.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:47.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:48.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:48.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:48.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:48.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:49.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:49.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:49.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:49.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:50.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:50.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:50.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:50.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:51.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:51.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:51.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:51.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:52.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:52.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:52.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:52.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:53.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:53.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:53.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:53.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:54.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:54.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:54.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:54.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:55.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:55.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:55.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:55.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:56.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:56.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:56.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:56.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:57.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:57.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:57.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:57.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:58.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:58.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:58.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:58.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:59.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:35:59.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:35:59.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:35:59.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:00.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:00.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:00.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:00.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:01.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:01.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:01.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:01.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:02.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:02.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:02.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:02.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:03.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:03.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:03.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:03.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:04.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:04.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:04.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:04.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:05.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:05.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:05.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:05.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:06.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:06.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:06.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:06.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:07.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:07.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:07.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:07.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:08.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:08.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:08.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:08.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:09.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:09.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:09.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:09.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:10.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:10.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:10.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:10.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:11.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:11.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:11.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:11.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:12.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:12.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:12.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:12.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:13.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:13.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:13.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:13.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:14.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:14.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:14.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:14.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:15.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:15.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:15.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:15.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:16.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:16.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:16.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:16.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:17.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:17.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:17.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:17.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:18.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:18.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:18.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:18.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:19.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:19.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:19.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:19.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:20.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:20.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:20.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:20.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:21.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:21.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:21.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:21.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:22.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:22.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:22.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:22.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:23.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:23.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:23.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:23.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:24.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:24.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:24.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:24.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:25.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:25.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:25.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:25.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:26.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:26.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:26.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:26.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:27.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:27.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:27.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:27.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:28.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:28.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:28.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:28.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:29.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:29.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:29.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:29.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:30.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:30.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:30.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:30.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:31.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:31.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:31.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:31.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:32.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:32.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:32.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:32.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:33.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:33.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:33.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:33.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:34.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:34.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:34.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:34.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:35.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:35.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:35.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:35.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:36.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:36.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:36.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:36.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:37.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:37.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:37.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:37.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:38.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:38.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:38.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:38.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:39.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:39.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:39.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:39.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:40.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:40.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:40.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:40.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:41.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:41.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:41.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:41.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:42.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:42.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:42.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:42.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:43.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:43.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:43.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:43.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:44.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:44.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:44.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:44.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:45.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:45.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:45.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:45.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:46.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:46.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:46.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:46.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:47.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:47.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:47.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:47.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:48.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:48.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:48.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:48.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:49.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:49.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:49.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:49.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:50.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:50.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:50.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:50.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:51.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:51.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:51.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:51.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:52.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:52.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:52.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:52.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:53.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:53.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:53.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:53.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:54.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:54.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:54.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:54.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:55.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:55.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:55.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:55.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:56.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:56.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:56.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:56.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:57.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:57.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:57.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:57.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:58.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:58.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:58.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:58.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:59.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:36:59.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:36:59.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:36:59.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:00.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:00.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:00.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:00.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:01.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:01.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:01.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:01.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:02.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:02.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:02.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:02.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:03.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:03.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:03.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:03.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:04.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:04.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:04.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:04.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:05.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:05.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:05.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:05.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:06.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:06.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:06.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:06.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:07.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:07.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:07.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:07.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:08.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:08.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:08.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:08.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:09.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:09.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:09.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:09.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:10.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:10.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:10.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:10.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:11.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:11.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:11.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:11.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:12.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:12.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:12.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:12.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:13.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:13.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:13.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:13.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:14.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:14.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:14.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:14.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:15.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:15.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:15.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:15.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:16.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:16.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:16.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:16.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:17.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:17.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:17.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:17.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:18.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:18.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:18.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:18.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:19.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:19.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:19.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:19.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:20.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:20.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:20.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:20.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:21.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:21.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:21.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:21.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:22.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:22.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:22.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:22.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:23.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:23.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:23.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:23.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:24.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:24.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:24.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:24.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:25.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:25.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:25.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:25.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:26.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:26.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:26.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:26.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:27.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:27.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:27.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:27.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:28.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:28.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:28.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:28.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:29.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:29.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:29.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:29.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:30.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:30.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:30.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:30.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:31.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:31.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:31.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:31.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:32.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:32.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:32.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:32.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:33.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:33.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:33.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:33.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:34.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:34.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:34.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:34.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:35.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:35.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:35.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:35.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:36.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:36.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:36.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:36.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:37.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:37.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:37.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:37.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:38.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:38.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:38.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:38.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:39.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:39.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:39.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:39.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:40.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:40.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:40.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:40.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:41.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:41.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:41.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:41.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:42.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:42.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:42.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:42.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:43.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:43.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:43.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:43.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:44.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:44.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:44.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:44.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:45.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:45.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:45.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:45.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:46.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:46.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:46.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:46.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:47.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:47.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:47.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:47.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:48.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:48.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:48.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:48.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:49.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:49.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:49.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:49.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:50.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:50.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:50.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:50.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:51.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:51.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:51.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:51.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:52.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:52.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:52.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:52.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:53.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:53.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:53.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:53.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:54.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:54.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:54.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:54.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:55.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:55.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:55.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:55.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:56.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:56.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:56.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:56.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:57.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:57.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:57.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:57.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:58.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:58.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:59.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:58.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:59.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:37:59.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:37:59.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:37:59.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:00.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:00.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:01.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:01.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:01.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:01.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:01.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:01.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:02.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:02.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:02.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:02.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:03.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:03.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:03.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:03.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:04.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:04.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:04.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:04.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:05.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:05.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:05.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:05.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:06.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:06.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:06.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:07.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:07.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:07.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:07.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:08.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:08.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:08.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:08.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:09.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:09.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:09.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:09.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:10.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:10.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:10.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:10.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:11.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:11.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:11.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:11.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:12.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:12.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:12.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:12.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:13.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:13.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:13.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:13.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:14.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:14.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:14.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:14.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:15.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:15.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:15.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:15.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:16.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:16.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:16.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:16.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:17.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:17.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:17.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:17.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:18.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:18.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:18.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:18.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:19.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:19.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:19.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:19.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:20.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:20.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:20.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:20.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:21.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:21.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:21.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:21.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:22.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:22.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:22.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:22.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:23.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:23.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:23.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:23.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:24.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:24.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:24.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:24.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:25.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:25.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:25.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:25.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:26.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:26.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:26.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:26.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:27.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:27.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:27.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:27.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:28.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:28.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:28.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:28.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:29.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:29.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:29.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:29.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:30.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:30.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:30.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:30.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:31.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:31.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:31.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:31.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:32.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:32.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:32.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:32.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:33.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:33.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:33.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:33.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:34.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:34.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:34.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:34.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:35.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:35.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:35.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:35.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:36.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:36.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:36.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:36.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:37.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:37.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:37.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:37.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:38.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:38.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:39.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:39.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:39.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:39.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:40.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:40.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:40.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:40.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:41.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:41.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:41.365 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T01:38:41.361+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fa4030690 msgr2=0x7f5fa403bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-20T01:38:41.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:41.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:42.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:42.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:42.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:42.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:42.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:42.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:43.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:43.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:44.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:44.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:44.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:44.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:45.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:44.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:45.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:45.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:46.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:46.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:46.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:46.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:47.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:47.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:47.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:47.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:48.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:48.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:48.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:48.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:49.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:49.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:49.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:49.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:50.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:50.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:50.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:50.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:51.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:51.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:51.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:51.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:52.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:52.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:52.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:52.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:53.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:53.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:53.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:53.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:53.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:53.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:54.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:54.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:54.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:54.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:55.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:55.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:56.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:56.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:56.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:56.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:56.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:56.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:57.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:57.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:58.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:58.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:58.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:58.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:59.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:38:59.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:38:59.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:38:59.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:00.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:00.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:00.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:00.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:01.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:00.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:01.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:01.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:01.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:01.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:02.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:02.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:02.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:02.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:03.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:03.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:03.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:03.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:04.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:04.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:04.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:04.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:05.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:05.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:05.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:05.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:06.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:06.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:06.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:06.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:07.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:07.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:07.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:07.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:08.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:08.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:08.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:08.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:09.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:09.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:10.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:10.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:10.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:10.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:11.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:11.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:11.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:11.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:12.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:12.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:12.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:12.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:13.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:13.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:13.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:13.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:14.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:14.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:14.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:14.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:15.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:15.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:15.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:15.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:16.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:16.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:16.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:16.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:17.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:17.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:17.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:17.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:18.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:18.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:18.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:18.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:19.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:19.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:19.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:19.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:20.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:20.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:20.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:20.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:21.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:21.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:21.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:21.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:22.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:22.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:22.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:22.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:23.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:23.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:23.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:23.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:24.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:24.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:24.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:24.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:25.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:25.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:25.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:25.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:26.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:26.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:26.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:26.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:27.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:27.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:27.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:27.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:28.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:28.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:28.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:28.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:29.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:29.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:29.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:29.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:30.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:30.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:30.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:30.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:31.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:31.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:31.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:31.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:32.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:32.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:32.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:32.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:33.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:33.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:33.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:33.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:34.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:34.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:34.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:34.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:35.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:35.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:35.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:35.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:36.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:36.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:36.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:36.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:37.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:37.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:37.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:37.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:38.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:38.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:38.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:38.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:39.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:39.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:39.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:39.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:40.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:40.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:40.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:40.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:41.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:41.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:41.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:41.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:42.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:42.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:42.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:42.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:43.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:43.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:43.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:43.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:44.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:44.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:44.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:44.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:45.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:45.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:45.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:45.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:46.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:46.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:46.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:46.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:47.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:47.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:47.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:47.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:48.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:48.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:48.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:48.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:49.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:49.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:49.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:49.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:50.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:50.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:50.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:50.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:51.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:51.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:51.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:51.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:52.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:52.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:52.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:52.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:53.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:53.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:53.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:53.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:54.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:54.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:54.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:54.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:55.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:55.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:55.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:55.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:56.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:56.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:56.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:56.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:57.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:57.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:57.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:57.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:58.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:58.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:58.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:58.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:59.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:39:59.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:39:59.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:39:59.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:00.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:00.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:00.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:00.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:01.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:01.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:01.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:01.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:02.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:02.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:02.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:02.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:03.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:03.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:03.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:03.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:04.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:04.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:04.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:04.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:05.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:05.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:05.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:05.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:06.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:06.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:06.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:06.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:07.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:07.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:07.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:07.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:08.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:08.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:08.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:08.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:09.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:09.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:09.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:09.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:10.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:10.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:10.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:10.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:11.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:11.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:11.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:11.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:12.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:12.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:12.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:12.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:13.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:13.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:13.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:13.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:14.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:14.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:14.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:14.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:15.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:15.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:15.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:15.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:16.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:16.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:16.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:16.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:17.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:17.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:17.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:17.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:18.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:18.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:18.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:18.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:19.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:19.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:19.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:19.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:20.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:20.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:20.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:20.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:21.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:21.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:21.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:21.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:22.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:22.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:22.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:22.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:23.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:23.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:23.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:23.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:24.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:24.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:24.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:24.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:25.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:25.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:25.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:25.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:26.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:26.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:26.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:26.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:27.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:27.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:27.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:27.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:28.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:28.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:28.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:28.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:29.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:29.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:29.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:29.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:30.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:30.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:30.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:30.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:31.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:31.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:31.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:31.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:32.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:32.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:32.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:32.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:33.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:33.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:33.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:33.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:34.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:34.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:34.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:34.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:35.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:35.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:35.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:35.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:36.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:36.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:36.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:36.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:37.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:37.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:37.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:37.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:38.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:38.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:38.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:38.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:39.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:39.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:39.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:39.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:40.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:40.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:40.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:40.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:41.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:41.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:41.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:41.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:42.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:42.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:42.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:42.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:43.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:43.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:43.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:43.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:44.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:44.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:44.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:44.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:45.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:45.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:45.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:45.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:46.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:46.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:46.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:46.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:47.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:47.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:47.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:47.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:48.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:48.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:48.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:48.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:49.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:49.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:49.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:49.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:50.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:50.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:50.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:50.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:51.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:51.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:51.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:51.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:52.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:52.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:52.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:53.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:53.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:53.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:53.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:54.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:54.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:54.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:54.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:55.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:55.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:55.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:55.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:56.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:56.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:56.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:56.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:57.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:57.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:57.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:57.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:58.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:58.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:58.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:58.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:59.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:40:59.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:40:59.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:40:59.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:00.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:00.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:00.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:00.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:01.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:01.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:01.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:01.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:02.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:02.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:02.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:02.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:03.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:03.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:03.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:03.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:04.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:04.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:04.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:04.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:05.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:05.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:05.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:05.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:06.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:06.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:06.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:06.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:07.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:07.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:07.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:07.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:08.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:08.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:08.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:08.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:09.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:09.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:09.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:09.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:10.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:10.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:10.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:10.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:11.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:11.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:11.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:11.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:12.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:12.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:12.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:12.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:13.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:13.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:13.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:13.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:14.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:14.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:14.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:14.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:15.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:15.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:15.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:15.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:16.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:16.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:16.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:16.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:17.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:17.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:17.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:17.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:18.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:18.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:18.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:18.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:19.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:19.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:19.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:19.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:20.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:20.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:20.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:20.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:21.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:21.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:21.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:21.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:22.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:22.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:22.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:22.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:23.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:23.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:23.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:23.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:24.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:24.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:24.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:24.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:25.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:25.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:25.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:25.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:26.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:26.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:26.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:26.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:27.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:27.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:27.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:27.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:28.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:28.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:28.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:28.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:29.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:29.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:29.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:29.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:30.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:30.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:30.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:30.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:31.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:31.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:31.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:31.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:32.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:32.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:32.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:32.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:33.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:33.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:33.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:33.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:34.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:34.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:34.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:34.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:35.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:35.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:35.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:35.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:36.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:36.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:36.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:36.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:37.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:37.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:37.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:37.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:38.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:38.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:38.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:38.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:39.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:39.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:39.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:39.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:40.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:40.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:40.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:40.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:41.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:41.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:41.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:41.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:42.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:42.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:42.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:42.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:43.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:43.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:43.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:43.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:44.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:44.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:44.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:44.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:45.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:45.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:45.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:45.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:46.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:46.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:46.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:46.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:47.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:47.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:47.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:47.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:48.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:48.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:48.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:48.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:49.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:49.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:49.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:49.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:50.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:50.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:50.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:50.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:51.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:51.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:51.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:51.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:52.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:52.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:52.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:52.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:53.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:53.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:53.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:53.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:54.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:54.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:54.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:54.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:55.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:55.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:55.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:55.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:56.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:56.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:56.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:56.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:57.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:57.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:57.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:57.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:58.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:58.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:58.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:58.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:59.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:41:59.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:41:59.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:41:59.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:00.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:00.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:00.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:00.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:01.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:01.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:01.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:01.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:02.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:02.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:02.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:02.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:03.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:03.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:03.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:03.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:04.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:04.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:04.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:04.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:05.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:05.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:05.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:05.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:06.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:06.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:06.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:06.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:07.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:07.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:07.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:07.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:08.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:08.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:08.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:08.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:09.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:09.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:09.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:09.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:10.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:10.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:10.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:10.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:11.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:11.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:11.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:11.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:12.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:12.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:12.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:12.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:13.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:13.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:13.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:13.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:14.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:14.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:14.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:14.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:15.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:15.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:15.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:15.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:16.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:16.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:16.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:16.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:17.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:17.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:17.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:17.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:18.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:18.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:18.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:18.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:19.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:19.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:19.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:19.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:20.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:20.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:20.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:20.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:21.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:21.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:21.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:21.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:22.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:22.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:22.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:22.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:23.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:23.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:23.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:23.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:24.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:24.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:24.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:24.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:25.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:25.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:25.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:25.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:26.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:26.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:26.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:26.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:27.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:27.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:27.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:27.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:28.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:28.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:28.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:28.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:29.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:29.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:29.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:29.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:30.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:30.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:30.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:30.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:31.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:31.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:31.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:31.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:32.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:32.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:32.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:32.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:33.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:33.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:33.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:33.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:34.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:34.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:34.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:34.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:35.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:35.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:35.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:35.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:36.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:36.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:36.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:36.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:37.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:37.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:37.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:37.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:38.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:38.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:38.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:38.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:39.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:39.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:39.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:39.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:40.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:40.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:40.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:40.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:41.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:41.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:41.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:41.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:42.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:42.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:42.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:42.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:43.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:43.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:43.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:43.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:44.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:44.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:44.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:44.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:45.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:45.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:45.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:45.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:46.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:46.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:46.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:46.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:47.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:47.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:47.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:47.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:48.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:48.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:48.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:48.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:49.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:49.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:49.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:49.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:50.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:50.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:50.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:50.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:51.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:51.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:51.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:51.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:52.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:52.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:52.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:52.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:53.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:53.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:53.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:53.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:54.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:54.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:54.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:54.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:55.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:55.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:55.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:55.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:56.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:56.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:56.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:56.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:57.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:57.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:57.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:57.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:58.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:58.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:58.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:58.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:59.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:42:59.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:42:59.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:42:59.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:00.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:00.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:00.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:00.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:01.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:01.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:01.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:01.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:02.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:02.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:02.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:02.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:03.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:03.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:03.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:03.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:04.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:04.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:04.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:04.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:05.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:05.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:05.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:05.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:06.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:06.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:06.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:06.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:07.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:07.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:07.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:07.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:08.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:08.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:08.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:08.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:09.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:09.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:09.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:09.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:10.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:10.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:10.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:10.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:11.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:11.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:11.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:11.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:12.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:12.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:12.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:12.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:13.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:13.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:13.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:13.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:14.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:14.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:15.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:14.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:15.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:15.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:15.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:15.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:16.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:16.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:16.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:16.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:17.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:17.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:17.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:17.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:18.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:18.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:18.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:18.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:19.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:19.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:19.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:19.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:20.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:20.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:21.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:21.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:21.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:21.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:22.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:22.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:22.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:22.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:23.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:23.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:23.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:23.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:24.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:24.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:24.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:24.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:25.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:25.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:25.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:25.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:26.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:26.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:26.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:26.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:27.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:27.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:27.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:27.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:28.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:28.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:28.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:28.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:29.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:29.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:29.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:29.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:30.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:30.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:30.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:30.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:31.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:31.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:31.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:31.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:32.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:32.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:32.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:32.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:33.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:33.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:33.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:33.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:34.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:34.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:34.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:34.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:35.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:35.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:35.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:35.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:36.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:36.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:36.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:36.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:37.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:37.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:37.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:37.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:38.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:38.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:38.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:38.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:39.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:39.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:39.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:39.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:40.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:40.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:40.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:40.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:41.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:41.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:41.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:41.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:42.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:42.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:42.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:42.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:43.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:43.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:43.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:43.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:44.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:44.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:44.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:44.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:45.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:45.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:45.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:45.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:46.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:46.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:46.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:46.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:47.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:47.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:47.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:47.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:48.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:48.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:48.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:48.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:49.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:49.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:49.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:49.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:50.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:50.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:50.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:50.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:51.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:51.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:51.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:51.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:52.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:52.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:52.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:52.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:53.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:53.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:53.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:53.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:53.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:53.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:54.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:54.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:54.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:54.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:55.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:55.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:55.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:55.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:56.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:56.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:57.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:57.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:57.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:57.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:58.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:58.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:58.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:58.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:59.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:43:59.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:43:59.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:43:59.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:00.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:00.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:00.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:00.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:01.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:01.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:01.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:01.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:02.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:02.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:02.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:02.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:03.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:03.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:03.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:03.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:04.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:04.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:04.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:04.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:05.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:05.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:05.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:05.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:06.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:06.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:06.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:06.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:07.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:07.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:07.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:07.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:08.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:08.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:08.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:08.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:09.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:09.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:09.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:09.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:10.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:10.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:10.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:10.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:11.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:11.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:11.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:11.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:12.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:12.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:12.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:12.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:13.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:13.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:13.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:13.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:14.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:14.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:14.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:14.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:15.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:15.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:15.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:15.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:16.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:16.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:16.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:16.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:17.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:17.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:17.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:17.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:17.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:17.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:18.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:18.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:18.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:18.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:19.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:19.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:19.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:19.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:20.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:20.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:21.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:21.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:21.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:21.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:22.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:21.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:22.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:22.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:23.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:23.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:23.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:23.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:24.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:23.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:24.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:24.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:24.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:24.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:25.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:25.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:25.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:25.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:26.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:26.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:26.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:26.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:27.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:27.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:27.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:27.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:28.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:28.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:28.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:28.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:29.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:29.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:29.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:29.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:30.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:30.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:30.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:30.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:31.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:31.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:31.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:31.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:32.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:32.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:32.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:32.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:33.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:33.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:33.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:33.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:34.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:34.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:34.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:34.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:35.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:35.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:35.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:35.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:36.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:36.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:36.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:36.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:37.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:37.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:37.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:37.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:38.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:38.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:38.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:38.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:39.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:39.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:39.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:39.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:40.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:40.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:40.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:40.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:41.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:41.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:41.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:41.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:42.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:42.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:42.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:42.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:43.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:43.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:43.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:43.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:44.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:44.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:44.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:44.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:45.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:45.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:45.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:45.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:46.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:46.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:46.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:46.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:47.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:47.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:47.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:47.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:48.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:48.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:48.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:48.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:49.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:49.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:49.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:49.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:50.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:50.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:50.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:50.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:51.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:51.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:51.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:51.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:52.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:52.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:52.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:52.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:53.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:53.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:53.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:53.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:54.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:54.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:54.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:54.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:55.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:55.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:55.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:55.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:56.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:56.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:56.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:56.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:57.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:57.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:57.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:57.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:58.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:58.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:58.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:58.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:59.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:44:59.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:44:59.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:44:59.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:00.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:00.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:00.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:00.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:01.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:01.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:01.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:01.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:02.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:02.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:02.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:02.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:03.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:03.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:03.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:03.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:04.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:04.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:04.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:04.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:05.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:05.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:05.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:05.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:06.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:06.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:06.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:06.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:07.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:07.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:07.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:07.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:08.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:08.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:08.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:08.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:09.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:09.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:09.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:09.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:10.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:10.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:10.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:10.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:11.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:11.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:11.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:11.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:12.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:12.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:12.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:12.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:13.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:13.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:13.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:13.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:14.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:14.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:14.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:14.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:15.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:15.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:15.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:15.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:16.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:16.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:16.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:16.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:17.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:17.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:17.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:17.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:18.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:18.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:18.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:18.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:19.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:19.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:19.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:19.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:20.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:20.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:20.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:20.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:21.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:21.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:21.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:21.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:22.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:22.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:22.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:22.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:23.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:23.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:23.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:23.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:24.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:24.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:24.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:24.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:25.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:25.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:25.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:25.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:26.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:26.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:26.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:26.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:27.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:27.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:27.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:27.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:28.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:28.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:28.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:28.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:29.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:29.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:29.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:29.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:30.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:30.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:30.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:30.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:31.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:31.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:31.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:31.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:32.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:32.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:32.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:32.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:33.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:33.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:33.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:33.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:34.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:34.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:34.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:34.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:35.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:35.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:35.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:35.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:36.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:36.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:36.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:36.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:37.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:37.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:37.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:37.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:38.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:38.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:38.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:39.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:39.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:39.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:39.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:40.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:40.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:40.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:40.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:41.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:41.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:41.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:41.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:42.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:42.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:42.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:42.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:43.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:43.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:43.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:43.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:44.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:44.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:44.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:44.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:45.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:45.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:45.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:45.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:46.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:46.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:46.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:46.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:47.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:47.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:47.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:47.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:48.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:48.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:48.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:48.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:49.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:49.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:49.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:49.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:50.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:50.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:50.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:50.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:51.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:51.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:51.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:51.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:52.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:52.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:52.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:52.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:53.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:53.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:53.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:53.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:54.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:54.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:54.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:54.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:55.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:55.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:55.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:55.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:56.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:56.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:56.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:56.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:57.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:57.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:57.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:57.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:58.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:58.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:58.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:58.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:59.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:45:59.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:45:59.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:45:59.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:00.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:00.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:00.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:00.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:01.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:01.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:01.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:01.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:02.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:02.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:02.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:02.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:03.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:03.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:03.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:03.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:04.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:04.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:04.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:04.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:05.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:05.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:05.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:05.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:06.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:06.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:06.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:06.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:07.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:07.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:07.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:07.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:08.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:08.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:08.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:08.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:09.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:09.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:09.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:09.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:10.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:10.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:10.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:10.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:11.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:11.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:11.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:11.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:12.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:12.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:12.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:12.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:13.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:13.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:13.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:13.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:14.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:14.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:14.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:14.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:15.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:15.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:15.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:15.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:16.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:16.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:16.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:16.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:17.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:17.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:17.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:17.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:18.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:18.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:18.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:18.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:19.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:19.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:19.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:19.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:20.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:20.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:20.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:20.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:21.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:21.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:21.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:21.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:22.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:22.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:22.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:22.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:23.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:23.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:23.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:23.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:24.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:24.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:24.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:24.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:25.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:25.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:25.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:25.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:26.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:26.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:26.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:26.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:27.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:27.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:27.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:27.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:28.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:28.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:28.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:28.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:29.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:29.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:29.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:29.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:30.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:30.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:30.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:30.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:31.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:31.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:31.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:31.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:32.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:32.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:32.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:32.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:33.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:33.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:33.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:33.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:34.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:34.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:34.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:34.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:35.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:35.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:35.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:35.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:36.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:36.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:36.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:36.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:37.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:37.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:37.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:37.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:38.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:38.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:38.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:38.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:39.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:39.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:39.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:39.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:40.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:40.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:40.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:40.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:41.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:41.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:41.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:41.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:42.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:42.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:42.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:42.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:43.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:43.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:43.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:43.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:44.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:44.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:44.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:44.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:45.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:45.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:45.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:45.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:46.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:46.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:46.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:46.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:47.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:47.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:47.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:47.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:48.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:48.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:48.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:48.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:49.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:49.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:49.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:49.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:50.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:50.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:50.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:50.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:51.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:51.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:51.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:51.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:52.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:52.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:52.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:52.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:53.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:53.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:53.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:53.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:54.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:54.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:54.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:54.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:55.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:55.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:55.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:55.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:56.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:56.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:56.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:56.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:57.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:57.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:57.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:57.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:58.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:58.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:58.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:58.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:59.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:46:59.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:46:59.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:46:59.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:00.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:00.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:00.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:00.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:01.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:01.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:01.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:01.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:02.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:02.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:02.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:02.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:03.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:03.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:03.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:03.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:04.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:04.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:04.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:04.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:05.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:05.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:05.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:05.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:06.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:06.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:06.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:06.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:07.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:07.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:07.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:07.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:08.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:08.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:08.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:08.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:09.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:09.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:09.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:09.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:10.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:10.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:10.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:10.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:11.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:11.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:11.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:11.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:12.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:12.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:12.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:12.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:13.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:13.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:13.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:13.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:14.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:14.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:14.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:14.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:15.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:15.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:15.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:15.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:16.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:16.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:16.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:16.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:17.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:17.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:17.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:17.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:18.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:18.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:18.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:18.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:19.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:19.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:19.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:19.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:20.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:20.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:20.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:20.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:21.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:21.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:21.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:21.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:22.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:22.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:23.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:23.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:23.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:23.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:24.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:24.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:24.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:24.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:25.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:25.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:25.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:25.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:26.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:26.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:26.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:26.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:27.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:27.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:27.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:27.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:28.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:28.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:28.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:28.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:29.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:29.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:29.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:29.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:30.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:30.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:30.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:30.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:31.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:31.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:31.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:31.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:32.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:32.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:32.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:32.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:33.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:33.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:33.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:33.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:34.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:34.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:35.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:35.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:35.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:35.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:36.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:36.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:36.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:36.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:37.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:37.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:37.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:37.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:38.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:38.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:38.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:38.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:39.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:39.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:39.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:39.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:40.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:40.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:40.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:40.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:41.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:41.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:41.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:41.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:42.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:42.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:42.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:42.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:43.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:43.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:43.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:43.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:44.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:44.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:44.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:44.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:45.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:45.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:45.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:45.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:46.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:46.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:46.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:46.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:47.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:47.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:47.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:47.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:48.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:48.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:48.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:48.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:49.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:49.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:49.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:49.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:50.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:50.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:50.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:50.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:51.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:51.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:51.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:51.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:52.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:52.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:52.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:52.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:53.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:53.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:53.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:53.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:54.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:54.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:54.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:54.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:55.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:55.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:55.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:55.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:56.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:56.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:56.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:56.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:57.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:57.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:57.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:57.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:58.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:58.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:58.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:58.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:59.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:47:59.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:47:59.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:47:59.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:00.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:00.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:00.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:00.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:01.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:01.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:01.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:01.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:02.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:02.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:02.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:02.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:03.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:03.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:03.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:03.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:04.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:04.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:04.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:04.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:05.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:05.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:05.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:05.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:06.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:06.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:06.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:06.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:07.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:07.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:07.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:07.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:08.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:08.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:08.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:08.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:09.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:09.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:09.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:09.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:10.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:10.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:10.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:10.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:11.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:11.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:11.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:11.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:12.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:12.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:12.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:12.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:13.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:13.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:13.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:13.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:14.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:14.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:14.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:14.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:15.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:15.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:15.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:15.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:16.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:16.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:16.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:16.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:17.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:17.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:17.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:17.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:18.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:18.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:18.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:18.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:19.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:19.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:19.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:19.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:19.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:19.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:20.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:20.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:20.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:20.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:21.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:21.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:21.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:21.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:22.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:22.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:22.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:22.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:23.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:23.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:24.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:23.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:24.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:24.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:25.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:25.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:25.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:25.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:26.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:26.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:26.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:26.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:26.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:26.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:27.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:27.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:27.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:27.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:28.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:28.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:28.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:28.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:29.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:29.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:29.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:29.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:30.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:30.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:30.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:30.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:31.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:31.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:31.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:31.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:32.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:32.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:32.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:32.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:33.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:33.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:33.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:33.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:34.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:34.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:35.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:34.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:35.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:35.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:36.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:36.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:36.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:36.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:37.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:37.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:37.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:37.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:38.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:38.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:38.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:38.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:39.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:39.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:39.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:39.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:40.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:40.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:40.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:40.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:41.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:41.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:41.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:41.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:42.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:42.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:42.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:42.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:43.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:43.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:43.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:43.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:44.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:44.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:44.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:44.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:45.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:45.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:45.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:45.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:46.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:46.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:46.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:46.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:47.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:47.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:47.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:47.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:48.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:48.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:48.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:48.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:49.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:49.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:49.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:49.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:50.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:50.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:50.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:50.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:51.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:51.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:51.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:51.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:52.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:52.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:52.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:52.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:53.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:53.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:53.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:53.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:54.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:54.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:54.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:54.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:55.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:55.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:55.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:55.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:56.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:56.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:56.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:56.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:57.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:57.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:57.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:57.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:58.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:58.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:58.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:58.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:59.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:48:59.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:48:59.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:48:59.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:00.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:00.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:00.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:00.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:01.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:01.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:01.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:01.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:02.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:02.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:02.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:02.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:03.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:03.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:03.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:03.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:04.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:04.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:04.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:04.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:05.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:05.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:05.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:05.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:06.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:06.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:06.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:06.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:07.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:07.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:07.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:07.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:08.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:08.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:08.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:08.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:09.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:09.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:09.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:09.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:10.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:10.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:10.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:10.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:11.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:11.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:11.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:11.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:12.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:12.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:12.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:12.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:13.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:13.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:13.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:13.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:14.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:14.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:14.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:14.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:15.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:15.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:15.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:15.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:16.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:16.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:16.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:16.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:17.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:17.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:17.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:17.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:18.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:18.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:18.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:18.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:19.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:19.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:19.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:19.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:20.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:20.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:20.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:20.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:21.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:21.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:21.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:21.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:22.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:22.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:22.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:22.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:23.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:23.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:23.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:23.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:24.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:24.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:24.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:24.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:25.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:25.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:25.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:25.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:26.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:26.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:26.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:26.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:27.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:27.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:27.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:27.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:28.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:28.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:28.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:28.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:29.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:29.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:29.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:29.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:30.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:30.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:30.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:30.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:31.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:31.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:31.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:31.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:32.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:32.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:32.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:32.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:33.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:33.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:33.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:33.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:34.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:34.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:34.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:34.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:35.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:35.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:35.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:35.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:36.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:36.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:36.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:36.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:37.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:37.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:37.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:37.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:38.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:38.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:38.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:38.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:39.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:39.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:39.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:39.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:40.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:40.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:40.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:40.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:41.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:41.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:41.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:41.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:42.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:42.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:42.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:42.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:43.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:43.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:43.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:43.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:44.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:44.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:44.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:44.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:45.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:45.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:45.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:45.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:46.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:46.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:46.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:46.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:47.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:47.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:47.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:47.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:48.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:48.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:48.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:48.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:49.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:49.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:49.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:49.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:50.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:50.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:50.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:50.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:51.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:51.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:51.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:51.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:52.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:52.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:52.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:52.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:53.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:53.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:53.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:53.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:53.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:53.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:54.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:54.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:55.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:55.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:55.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:55.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:55.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:55.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:56.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:57.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:57.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:57.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:57.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:58.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:58.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:58.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:58.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:59.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:49:59.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:49:59.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:49:59.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:00.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:00.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:00.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:00.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:01.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:01.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:01.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:01.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:01.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:01.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:02.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:02.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:02.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:02.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:03.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:03.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:04.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:03.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:04.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:04.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:05.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:05.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:05.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:05.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:05.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:05.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:06.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:06.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:07.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:07.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:07.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:07.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:07.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:07.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:08.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:08.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:08.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:08.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:09.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:09.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:09.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:09.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:10.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:10.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:10.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:10.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:11.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:11.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:11.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:11.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:12.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:12.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:12.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:12.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:13.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:13.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:13.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:13.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:14.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:14.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:15.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:15.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:15.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:15.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:16.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:16.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:16.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:16.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:17.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:17.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:17.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:17.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:18.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:18.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:18.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:18.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:19.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:19.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:19.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:19.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:20.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:20.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:20.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:20.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:20.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:20.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:21.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:21.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:21.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:21.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:22.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:22.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:23.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:23.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:23.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:23.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:24.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:24.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:24.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:24.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:24.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:24.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:25.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:25.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:26.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:26.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:26.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:26.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:27.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:27.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:27.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:27.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:28.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:28.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:28.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:28.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:28.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:28.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:29.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:29.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:29.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:29.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:30.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:30.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:30.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:30.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:31.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:31.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:32.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:32.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:32.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:32.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:33.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:33.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:33.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:33.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:34.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:34.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:34.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:34.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:35.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:35.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:35.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:35.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:36.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:36.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:36.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:36.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:37.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:37.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:37.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:37.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:38.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:38.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:38.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:38.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:39.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:39.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:39.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:39.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:40.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:40.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:40.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:40.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:41.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:41.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:41.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:41.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:42.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:42.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:42.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:42.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:43.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:43.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:43.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:43.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:44.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:44.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:44.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:44.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:45.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:45.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:45.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:45.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:45.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:45.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:46.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:46.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:46.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:46.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:47.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:47.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:47.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:47.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:48.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:48.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:49.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:49.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:49.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:49.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:50.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:50.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:50.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:50.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:51.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:51.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:51.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:51.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:52.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:52.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:52.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:52.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:52.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:52.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:53.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:53.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:53.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:53.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:54.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:54.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:54.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:54.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:55.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:55.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:55.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:55.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:56.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:56.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:56.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:56.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:57.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:57.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:58.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:58.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:58.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:58.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:58.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:58.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:59.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:50:59.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:50:59.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:50:59.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:00.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:00.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:00.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:00.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:01.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:01.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:01.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:01.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:02.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:02.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:02.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:02.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:03.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:03.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:03.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:03.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:04.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:04.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:04.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:04.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:05.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:05.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:05.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:05.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:06.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:06.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:06.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:06.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:07.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:07.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:07.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:07.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:08.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:08.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:08.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:08.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:09.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:09.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:09.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:09.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:10.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:10.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:10.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:10.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:11.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:11.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:11.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:11.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:12.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:12.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:12.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:12.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:13.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:13.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:13.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:13.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:14.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:14.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:14.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:14.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:15.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:15.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:15.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:15.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:16.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:16.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:16.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:16.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:17.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:17.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:17.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:17.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:18.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:18.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:18.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:18.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:19.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:19.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:19.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:19.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:20.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:20.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:20.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:20.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:21.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:21.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:21.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:21.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:22.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:22.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:22.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:22.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:23.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:23.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:23.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:23.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:24.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:24.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:24.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:24.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:25.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:25.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:25.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:25.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:26.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:26.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:26.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:26.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:27.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:27.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:27.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:27.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:28.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:28.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:28.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:28.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:29.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:29.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:29.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:29.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:30.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:30.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:30.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:30.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:31.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:31.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:31.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:31.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:32.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:32.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:32.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:32.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:33.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:33.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:33.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:33.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:34.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:34.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:34.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:34.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:35.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:35.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:35.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:35.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:36.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:36.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:36.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:36.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:37.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:37.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:37.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:37.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:38.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:38.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:38.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:38.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:39.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:39.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:39.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:39.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:40.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:40.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:40.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:40.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:41.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:41.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:41.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:41.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:42.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:42.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:42.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:42.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:43.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:43.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:43.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:43.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:44.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:44.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:44.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:44.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:45.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:45.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:45.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:45.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:46.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:46.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:46.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:46.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:47.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:47.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:47.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:47.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:48.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:48.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:48.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:48.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:49.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:49.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:49.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:49.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:50.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:50.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:50.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:50.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:51.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:51.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:51.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:51.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:52.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:52.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:52.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:52.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:53.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:53.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:53.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:53.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:54.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:54.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:54.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:54.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:55.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:55.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:55.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:55.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:56.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:56.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:56.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:56.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:57.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:57.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:57.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:57.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:58.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:58.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:58.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:58.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:59.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:51:59.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:51:59.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:51:59.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:00.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:00.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:00.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:00.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:01.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:01.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:01.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:01.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:02.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:02.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:02.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:02.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:03.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:03.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:03.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:03.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:04.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:04.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:04.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:04.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:05.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:05.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:05.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:05.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:06.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:06.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:06.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:06.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:07.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:07.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:07.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:07.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:08.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:08.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:08.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:08.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:09.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:09.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:09.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:09.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:10.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:10.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:11.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:11.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:11.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:11.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:12.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:12.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:12.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:12.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:13.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:13.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:13.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:13.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:13.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:13.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:14.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:14.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:14.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:14.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:15.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:15.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:15.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:15.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:16.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:16.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:16.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:16.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:17.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:17.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:17.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:17.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:18.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:18.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:19.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:19.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:19.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:19.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:19.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:19.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:20.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:20.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:21.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:21.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:21.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:21.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:21.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:21.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:22.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:22.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:23.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:23.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:23.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:23.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:24.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:24.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:24.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:24.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:25.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:25.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:25.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:25.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:26.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:26.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:26.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:26.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:27.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:27.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:27.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:27.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:28.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:28.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:28.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:28.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:29.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:29.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:29.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:29.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:30.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:30.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:30.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:30.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:31.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:31.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:31.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:31.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:32.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:32.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:32.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:32.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:33.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:33.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:33.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:33.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:34.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:34.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:34.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:34.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:35.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:35.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:35.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:35.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:36.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:36.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:36.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:36.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:37.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:37.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:37.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:37.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:38.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:38.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:38.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:38.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:39.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:39.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:39.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:39.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:40.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:40.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:40.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:40.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:41.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:41.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:41.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:41.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:42.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:42.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:42.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:42.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:43.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:43.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:43.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:43.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:44.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:44.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:44.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:44.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:45.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:45.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:45.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:45.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:46.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:46.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:46.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:46.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:47.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:47.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:47.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:47.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:48.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:48.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:48.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:48.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:49.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:49.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:49.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:49.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:50.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:50.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:50.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:50.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:51.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:51.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:51.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:51.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:52.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:52.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:52.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:52.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:53.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:53.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:53.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:53.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:54.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:54.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:54.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:54.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:55.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:55.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:55.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:55.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:56.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:56.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:56.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:56.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:57.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:57.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:57.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:57.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:58.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:58.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:58.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:58.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:59.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:52:59.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:52:59.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:52:59.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:00.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:00.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:00.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:00.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:01.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:01.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:01.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:01.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:02.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:02.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:02.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:02.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:03.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:03.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:03.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:03.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:04.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:04.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:04.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:04.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:05.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:05.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:05.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:05.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:06.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:06.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:06.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:06.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:07.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:07.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:07.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:07.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:08.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:08.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:08.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:08.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:09.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:09.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:09.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:09.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:10.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:10.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:10.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:10.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:11.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:11.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:11.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:11.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:12.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:12.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:12.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:12.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:13.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:13.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:13.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:13.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:14.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:14.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:14.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:14.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:15.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:15.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:15.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:15.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:16.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:16.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:16.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:16.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:17.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:17.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:17.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:17.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:18.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:18.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:18.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:18.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:19.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:19.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:19.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:19.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:20.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:20.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:20.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:20.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:21.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:21.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:21.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:21.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:22.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:22.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:22.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:22.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:23.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:23.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:23.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:23.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:24.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:24.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:24.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:24.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:25.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:25.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:25.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:25.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:26.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:26.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:26.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:26.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:27.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:27.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:27.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:27.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:28.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:28.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:28.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:28.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:29.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:29.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:29.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:29.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:30.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:30.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:30.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:30.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:31.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:31.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:31.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:31.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:32.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:32.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:32.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:32.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:33.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:33.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:33.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:33.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:34.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:34.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:34.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:34.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:35.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:35.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:35.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:35.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:36.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:36.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:36.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:36.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:37.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:37.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:37.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:37.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:38.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:38.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:38.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:38.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:39.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:39.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:39.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:39.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:40.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:40.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:40.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:40.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:41.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:41.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:41.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:41.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:42.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:42.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:42.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:42.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:43.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:43.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:43.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:43.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:44.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:44.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:44.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:44.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:45.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:45.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:45.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:45.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:46.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:46.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:46.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:46.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:47.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:47.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:47.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:47.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:48.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:48.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:48.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:48.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:49.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:49.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:49.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:49.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:50.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:50.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:50.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:50.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:51.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:51.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:51.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:51.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:52.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:52.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:52.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:52.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:53.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:53.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:53.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:53.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:54.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:54.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:54.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:54.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:55.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:55.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:55.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:55.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:56.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:56.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:56.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:56.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:57.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:57.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:57.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:57.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:58.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:58.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:58.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:58.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:59.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:53:59.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:53:59.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:53:59.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:00.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:00.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:00.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:00.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:01.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:01.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:01.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:01.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:02.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:02.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:02.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:02.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:03.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:03.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:03.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:03.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:04.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:04.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:04.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:04.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:05.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:05.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:05.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:05.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:06.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:06.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:06.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:06.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:07.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:07.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:07.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:07.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:08.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:08.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:08.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:08.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:09.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:09.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:09.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:09.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:10.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:10.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:10.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:10.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:11.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:11.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:11.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:11.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:12.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:12.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:12.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:12.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:13.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:13.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:13.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:13.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:14.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:14.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:14.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:14.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:15.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:15.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:15.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:15.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:16.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:16.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:16.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:16.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:17.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:17.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:17.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:17.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:18.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:18.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:18.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:18.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:19.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:19.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:19.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:19.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:20.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:20.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:20.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:20.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:21.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:21.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:21.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:21.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:22.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:22.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:22.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:22.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:23.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:23.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:23.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:23.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:24.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:24.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:24.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:24.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:25.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:25.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:25.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:25.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:26.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:26.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:26.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:26.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:27.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:27.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:27.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:27.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:28.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:28.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:28.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:28.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:29.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:29.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:29.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:29.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:30.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:30.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:30.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:30.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:31.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:31.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:31.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:31.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:32.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:32.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:32.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:32.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:33.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:33.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:33.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:33.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:34.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:34.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:34.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:34.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:35.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:35.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:35.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:35.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:36.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:36.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:36.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:36.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:37.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:37.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:37.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:37.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:38.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:38.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:38.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:38.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:39.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:39.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:39.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:39.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:40.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:40.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:40.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:40.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:41.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:41.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:41.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:41.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:42.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:42.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:42.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:42.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:43.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:43.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:43.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:43.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:43.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:43.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:44.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:44.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:44.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:44.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:45.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:45.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:45.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:45.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:46.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:46.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:46.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:46.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:47.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:47.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:47.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:48.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:48.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:48.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:48.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:49.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:49.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:49.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:49.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:50.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:50.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:50.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:50.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:51.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:51.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:51.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:51.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:52.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:52.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:53.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:53.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:53.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:53.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:54.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:54.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:54.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:54.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:55.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:55.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:55.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:55.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:56.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:56.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:56.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:56.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:57.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:57.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:57.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:57.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:58.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:58.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:58.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:58.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:59.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:54:59.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:54:59.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:54:59.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:00.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:00.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:00.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:00.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:01.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:01.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:01.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:01.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:02.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:02.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:02.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:02.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:03.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:03.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:03.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:03.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:04.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:04.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:04.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:04.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:05.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:05.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:05.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:05.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:06.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:06.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:06.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:06.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:07.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:07.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:07.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:07.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:08.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:08.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:08.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:08.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:09.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:09.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:09.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:09.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:10.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:10.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:10.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:10.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:11.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:11.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:11.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:11.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:12.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:12.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:12.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:12.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:13.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:13.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:13.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:13.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:14.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:14.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:14.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:14.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:15.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:15.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:15.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:15.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:16.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:16.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:16.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:16.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:17.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:17.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:17.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:17.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:18.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:18.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:18.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:18.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:19.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:19.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:19.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:19.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:20.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:20.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:20.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:20.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:21.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:21.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:21.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:21.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:22.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:22.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:22.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:22.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:23.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:23.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:23.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:23.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:24.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:24.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:24.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:24.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:25.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:25.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:25.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:25.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:26.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:26.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:26.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:26.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:27.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:27.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:27.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:27.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:28.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:28.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:28.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:28.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:29.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:29.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:29.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:29.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:30.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:30.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:30.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:30.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:31.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:31.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:31.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:31.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:32.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:32.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:32.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:32.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:33.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:33.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:33.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:33.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:34.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:34.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:34.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:34.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:35.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:35.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:35.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:35.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:36.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:36.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:36.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:36.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:37.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:37.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:37.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:37.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:38.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:38.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:38.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:38.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:39.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:39.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:39.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:39.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:40.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:40.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:40.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:40.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:41.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:41.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:41.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:41.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:42.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:42.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:42.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:42.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:43.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:43.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:43.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:43.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:44.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:44.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:44.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:44.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:45.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:45.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:45.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:45.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:46.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:46.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:46.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:46.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:47.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:47.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:47.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:47.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:48.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:48.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:48.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:48.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:49.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:49.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:49.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:49.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:50.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:50.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:50.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:50.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:51.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:51.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:51.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:51.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:52.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:52.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:52.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:52.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:53.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:53.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:53.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:53.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:54.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:54.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:54.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:54.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:55.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:55.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:55.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:55.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:56.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:56.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:56.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:56.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:57.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:57.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:57.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:57.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:58.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:58.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:58.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:58.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:59.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:55:59.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:55:59.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:55:59.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:00.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:00.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:00.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:00.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:01.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:01.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:01.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:01.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:02.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:02.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:02.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:02.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:03.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:03.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:03.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:03.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:04.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:04.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:04.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:04.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:05.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:05.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:05.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:05.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:06.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:06.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:06.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:06.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:07.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:07.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:07.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:07.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:08.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:08.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:08.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:08.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:09.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:09.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:09.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:09.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:10.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:10.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:10.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:10.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:11.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:11.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:11.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:11.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:12.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:12.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:12.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:12.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:13.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:13.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:13.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:13.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:14.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:14.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:14.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:14.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:15.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:15.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:15.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:15.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:16.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:16.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:16.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:16.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:17.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:17.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:17.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:17.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:18.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:18.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:18.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:18.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:19.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:19.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:19.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:19.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:20.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:20.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:20.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:20.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:21.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:21.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:21.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:21.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:22.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:22.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:22.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:22.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:23.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:23.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:23.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:23.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:24.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:24.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:24.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:24.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:25.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:25.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:25.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:25.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:26.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:26.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:26.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:26.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:27.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:27.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:27.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:27.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:28.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:28.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:28.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:28.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:29.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:29.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:29.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:29.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:30.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:30.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:30.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:30.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:31.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:31.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:31.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:31.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:32.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:32.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:32.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:32.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:33.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:33.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:33.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:33.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:34.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:34.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:34.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:34.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:35.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:35.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:35.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:35.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:36.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:36.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:36.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:36.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:37.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:37.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:37.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:37.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:38.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:38.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:38.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:38.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:39.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:39.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:39.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:39.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:40.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:40.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:40.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:40.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:41.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:41.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:41.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:41.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:42.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:42.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:42.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:42.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:43.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:43.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:43.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:43.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:44.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:44.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:44.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:44.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:45.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:45.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:45.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:45.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:46.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:46.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:46.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:46.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:47.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:47.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:47.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:47.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:48.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:48.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:48.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:48.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:49.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:49.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:49.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:49.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:50.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:50.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:50.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:50.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:51.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:51.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:51.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:51.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:52.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:52.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:52.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:52.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:53.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:53.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:53.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:53.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:54.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:54.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:54.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:54.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:55.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:55.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:55.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:55.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:56.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:56.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:56.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:56.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:57.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:57.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:57.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:57.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:58.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:58.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:58.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:58.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:59.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:56:59.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:56:59.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:56:59.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:00.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:00.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:00.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:00.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:01.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:01.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:01.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:01.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:02.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:02.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:02.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:02.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:03.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:03.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:03.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:03.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:04.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:04.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:04.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:04.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:05.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:05.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:05.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:05.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:06.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:06.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:06.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:06.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:07.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:07.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:07.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:07.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:08.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:08.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:08.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:08.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:09.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:09.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:09.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:09.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:10.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:10.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:10.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:10.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:11.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:11.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:11.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:11.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:12.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:12.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:12.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:12.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:13.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:13.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:13.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:13.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:14.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:14.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:14.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:14.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:15.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:15.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:15.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:15.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:16.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:16.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:16.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:16.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:17.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:17.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:17.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:17.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:18.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:18.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:18.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:18.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:19.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:19.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:19.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:19.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:20.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:20.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:20.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:20.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:21.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:21.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:21.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:21.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:22.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:22.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:22.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:22.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:23.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:23.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:23.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:23.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:24.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:24.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:24.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:24.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:25.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:25.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:25.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:25.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:26.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:26.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:26.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:26.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:27.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:27.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:27.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:27.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:28.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:28.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:28.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:28.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:29.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:29.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:29.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:29.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:30.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:30.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:30.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:30.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:31.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:31.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:31.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:31.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:32.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:32.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:32.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:32.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:33.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:33.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:33.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:33.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:34.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:34.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:34.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:34.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:35.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:35.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:35.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:35.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:36.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:36.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:36.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:36.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:37.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:37.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:37.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:37.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:38.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:38.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:38.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:38.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:39.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:39.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:39.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:39.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:40.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:40.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:40.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:40.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:41.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:41.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:41.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:41.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:42.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:42.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:42.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:42.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:43.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:43.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:43.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:43.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:44.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:44.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:44.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:44.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:45.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:45.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:45.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:45.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:46.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:46.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:46.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:46.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:47.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:47.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:47.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:47.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:48.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:48.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:48.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:48.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:49.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:49.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:49.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:49.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:50.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:50.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:50.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:50.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:51.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:51.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:51.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:51.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:52.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:52.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:52.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:52.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:53.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:53.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:53.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:53.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:54.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:54.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:54.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:54.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:55.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:55.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:55.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:55.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:56.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:56.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:56.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:56.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:57.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:57.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:57.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:57.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:58.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:58.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:58.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:58.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:59.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:57:59.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:57:59.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:57:59.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:00.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:00.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:00.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:00.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:01.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:01.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:01.525 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T01:58:01.521+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fa40f5c40 msgr2=0x7f5fa4127b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-20T01:58:01.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:01.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:02.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:02.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:02.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:02.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:03.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:03.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:03.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:03.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:04.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:04.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:04.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:04.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:05.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:05.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:05.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:05.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:06.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:06.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:06.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:06.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:07.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:07.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:07.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:07.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:08.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:08.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:08.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:08.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:09.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:09.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:09.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:09.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:10.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:10.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:10.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:10.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:11.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:11.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:11.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:11.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:12.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:12.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:12.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:12.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:13.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:13.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:13.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:13.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:14.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:14.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:14.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:14.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:15.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:15.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:16.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:16.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:16.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:16.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:17.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:17.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:17.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:17.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:18.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:18.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:18.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:18.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:18.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:18.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:19.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:19.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:20.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:20.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:20.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:20.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:21.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:21.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:21.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:21.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:22.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:22.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:22.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:22.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:23.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:23.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:23.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:23.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:24.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:24.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:24.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:24.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:25.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:25.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:25.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:25.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:26.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:26.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:26.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:26.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:27.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:27.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:27.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:27.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:27.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:27.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:28.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:28.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:29.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:29.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:29.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:29.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:30.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:30.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:30.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:30.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:31.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:31.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:31.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:31.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:32.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:32.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:32.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:32.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:33.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:33.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:33.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:33.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:34.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:34.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:34.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:34.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:35.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:35.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:35.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:35.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:36.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:36.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:36.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:36.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:37.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:37.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:37.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:37.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:38.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:38.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:38.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:38.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:39.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:39.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:39.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:39.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:40.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:40.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:40.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:40.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:41.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:41.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:41.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:41.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:42.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:42.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:42.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:42.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:43.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:43.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:43.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:43.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:44.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:44.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:44.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:44.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:45.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:45.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:45.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:45.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:46.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:46.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:46.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:46.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:47.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:47.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:47.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:47.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:48.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:48.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:48.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:48.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:49.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:49.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:49.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:49.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:50.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:50.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:50.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:50.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:51.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:51.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:51.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:51.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:52.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:52.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:52.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:52.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:53.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:53.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:53.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:53.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:54.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:54.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:54.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:54.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:55.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:55.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:55.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:55.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:56.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:56.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:56.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:56.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:57.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:57.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:57.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:57.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:58.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:58.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:58.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:58.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:59.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:58:59.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:58:59.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:58:59.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:00.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:00.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:00.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:00.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:01.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:01.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:01.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:01.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:02.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:02.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:02.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:02.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:03.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:03.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:03.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:03.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:04.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:04.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:04.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:04.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:05.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:05.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:05.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:05.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:06.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:06.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:06.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:06.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:07.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:07.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:07.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:07.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:08.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:08.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:08.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:08.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:09.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:09.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:09.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:09.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:10.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:10.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:10.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:10.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:11.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:11.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:11.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:11.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:12.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:12.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:12.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:12.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:13.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:13.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:13.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:13.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:14.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:14.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:14.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:14.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:15.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:15.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:15.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:15.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:16.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:16.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:16.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:16.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:17.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:17.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:17.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:17.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:18.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:18.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:18.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:18.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:19.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:19.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:19.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:19.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:20.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:20.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:20.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:20.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:21.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:21.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:21.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:21.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:22.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:22.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:22.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:22.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:23.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:23.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:23.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:23.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:24.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:24.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:24.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:24.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:25.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:25.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:25.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:25.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:26.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:26.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:26.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:26.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:27.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:27.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:28.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:28.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:28.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:28.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:28.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:28.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:29.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:29.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:29.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:29.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:30.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:30.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:30.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:30.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:31.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:31.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:31.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:31.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:32.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:32.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:32.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:32.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:33.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:33.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:33.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:33.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:34.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:34.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:34.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:34.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:35.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:35.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:35.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:35.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:36.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:36.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:36.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:36.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:37.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:37.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:37.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:37.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:38.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:38.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:38.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:38.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:39.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:39.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:39.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:39.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:40.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:40.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:40.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:40.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:41.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:41.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:42.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:42.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:42.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:42.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:42.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:42.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:43.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:43.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:44.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:44.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:44.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:44.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:45.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:45.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:45.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:45.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:46.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:45.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:46.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:46.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:47.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:47.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:47.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:47.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:48.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:48.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:48.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:48.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:49.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:49.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:49.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:49.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:50.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:50.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:50.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:50.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:51.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:51.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:51.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:51.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:52.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:52.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:52.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:52.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:53.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:52.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:53.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:53.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:53.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:53.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:54.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:54.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:54.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:54.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:55.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:55.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:55.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:55.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:56.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:56.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:57.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:57.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:57.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:57.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:58.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:58.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:58.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:58.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:59.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:59.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:59.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T01:59:59.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T01:59:59.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T01:59:59.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:00.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:00.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:00.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:00.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:01.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:01.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:02.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:02.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:02.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:02.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:03.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:03.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:03.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:03.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:04.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:04.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:04.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:04.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:05.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:05.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:05.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:05.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:06.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:06.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:06.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:06.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:07.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:07.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:07.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:07.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:08.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:08.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:08.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:08.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:09.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:09.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:09.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:09.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:10.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:10.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:10.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:10.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:11.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:11.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:11.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:11.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:12.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:12.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:12.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:12.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:13.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:12.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:13.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:13.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:14.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:14.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:14.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:14.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:15.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:15.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:15.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:15.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:16.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:15.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:16.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:16.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:16.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:16.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:17.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:17.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:17.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:17.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:18.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:18.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:18.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:18.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:19.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:19.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:19.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:19.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:20.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:20.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:20.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:20.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:21.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:21.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:21.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:21.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:22.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:22.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:22.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:22.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:23.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:23.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:23.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:23.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:24.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:24.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:24.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:24.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:25.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:25.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:25.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:25.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:26.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:26.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:26.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:26.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:27.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:27.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:27.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:27.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:28.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:28.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:28.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:28.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:29.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:29.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:29.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:29.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:30.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:30.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:30.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:30.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:31.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:31.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:31.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:31.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:32.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:32.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:32.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:32.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:33.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:33.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:33.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:33.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:34.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:34.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:34.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:34.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:35.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:35.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:35.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:35.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:36.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:36.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:36.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:36.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:37.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:37.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:37.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:37.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:38.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:38.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:38.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:38.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:39.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:39.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:39.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:39.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:40.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:40.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:40.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:40.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:41.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:41.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:41.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:41.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:42.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:42.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:42.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:42.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:43.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:43.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:43.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:43.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:44.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:44.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:44.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:44.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:45.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:45.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:45.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:45.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:46.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:46.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:46.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:46.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:47.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:47.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:47.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:47.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:48.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:48.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:48.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:48.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:49.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:49.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:49.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:49.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:50.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:50.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:50.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:50.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:51.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:51.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:51.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:51.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:52.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:52.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:52.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:52.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:53.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:53.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:53.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:53.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:54.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:54.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:54.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:54.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:55.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:55.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:55.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:55.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:56.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:56.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:56.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:56.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:57.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:57.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:57.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:57.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:58.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:58.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:58.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:58.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:59.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:00:59.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:00:59.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:00:59.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:00.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:00.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:00.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:00.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:01.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:01.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:01.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:01.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:02.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:02.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:02.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:02.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:03.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:03.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:03.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:03.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:04.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:04.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:04.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:04.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:05.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:05.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:05.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:05.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:06.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:06.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:06.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:06.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:07.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:07.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:07.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:07.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:08.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:08.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:08.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:08.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:09.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:09.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:09.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:09.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:10.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:10.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:10.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:10.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:11.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:11.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:11.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:11.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:12.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:12.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:12.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:12.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:13.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:13.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:13.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:13.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:14.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:14.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:14.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:14.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:15.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:15.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:15.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:15.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:16.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:16.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:16.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:16.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:17.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:17.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:17.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:17.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:18.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:18.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:18.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:18.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:19.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:19.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:19.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:19.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:20.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:20.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:20.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:20.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:21.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:21.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:21.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:21.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:22.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:22.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:22.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:22.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:23.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:23.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:23.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:23.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:24.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:24.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:24.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:24.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:25.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:25.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:25.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:25.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:26.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:26.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:26.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:26.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:27.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:27.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:27.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:27.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:28.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:28.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:28.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:28.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:29.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:29.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:29.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:29.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:30.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:30.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:30.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:30.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:31.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:31.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:31.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:31.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:32.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:32.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:32.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:33.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:33.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:33.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:33.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:34.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:34.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:34.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:34.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:35.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:35.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:35.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:35.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:36.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:36.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:36.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:36.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:37.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:37.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:37.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:37.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:38.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:38.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:38.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:38.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:39.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:39.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:39.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:39.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:40.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:40.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:40.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:40.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:41.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:41.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:41.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:41.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:42.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:42.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:42.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:42.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:43.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:43.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:44.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:43.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:44.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:44.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:44.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:44.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:45.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:45.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:46.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:45.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:46.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:46.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:47.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:47.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:47.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:47.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:48.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:48.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:48.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:48.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:49.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:49.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:49.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:49.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:50.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:50.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:50.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:50.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:50.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:50.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:51.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:51.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:51.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:51.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:52.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:52.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:52.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:52.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:53.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:53.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:53.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:53.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:54.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:54.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:54.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:54.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:55.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:55.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:55.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:55.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:56.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:56.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:56.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:56.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:57.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:57.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:57.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:57.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:58.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:58.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:58.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:58.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:59.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:01:59.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:01:59.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:01:59.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:00.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:00.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:00.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:00.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:01.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:01.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:01.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:01.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:02.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:02.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:02.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:02.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:03.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:03.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:03.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:03.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:04.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:04.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:04.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:04.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:05.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:05.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:05.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:05.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:06.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:06.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:07.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:07.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:07.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:07.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:08.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:08.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:08.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:08.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:09.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:09.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:09.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:09.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:10.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:10.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:10.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:10.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:11.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:11.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:11.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:11.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:12.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:11.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:12.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:12.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:13.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:13.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:13.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:13.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:13.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:13.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:14.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:14.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:14.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:14.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:15.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:15.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:16.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:16.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:16.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:16.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:17.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:17.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:17.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:17.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:17.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:17.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:18.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:18.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:19.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:19.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:19.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:19.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:19.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:19.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:20.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:20.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:20.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:20.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:21.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:21.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:21.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:21.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:22.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:22.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:23.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:22.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:23.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:23.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:23.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:23.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:24.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:24.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:24.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:24.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:25.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:25.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:25.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:25.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:26.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:26.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:27.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:26.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:27.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:27.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:28.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:27.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:28.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:28.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:28.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:28.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:29.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:29.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:29.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:29.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:30.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:30.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:30.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:30.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:31.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:31.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:31.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:31.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:32.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:32.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:32.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:32.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:33.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:33.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:33.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:33.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:34.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:34.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:34.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:34.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:35.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:35.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:35.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:35.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:36.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:36.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:36.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:36.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:37.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:37.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:37.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:37.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:38.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:38.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:38.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:38.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:39.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:39.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:39.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:39.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:40.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:40.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:40.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:40.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:41.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:41.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:41.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:41.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:42.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:42.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:42.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:42.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:43.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:43.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:43.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:43.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:44.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:44.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:44.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:44.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:45.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:45.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:45.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:45.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:46.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:46.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:46.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:46.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:47.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:47.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:47.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:47.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:48.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:48.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:48.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:48.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:49.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:49.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:49.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:49.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:50.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:50.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:50.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:50.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:51.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:51.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:51.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:51.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:52.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:52.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:52.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:52.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:53.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:53.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:53.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:53.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:54.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:54.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:54.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:54.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:55.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:55.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:55.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:55.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:56.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:56.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:56.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:56.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:57.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:57.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:57.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:57.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:58.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:58.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:58.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:58.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:59.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:02:59.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:02:59.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:02:59.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:00.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:00.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:00.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:00.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:01.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:01.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:01.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:01.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:02.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:02.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:02.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:02.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:03.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:03.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:03.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:03.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:04.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:04.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:04.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:04.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:05.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:05.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:05.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:05.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:06.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:06.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:06.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:06.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:07.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:07.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:07.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:07.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:08.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:08.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:08.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:08.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:09.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:09.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:09.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:09.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:10.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:10.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:10.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:10.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:11.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:11.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:11.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:11.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:12.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:12.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:12.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:12.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:13.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:13.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:13.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:13.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:14.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:14.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:14.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:14.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:15.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:15.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:15.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:15.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:16.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:16.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:16.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:16.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:17.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:17.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:17.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:17.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:18.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:18.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:18.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:18.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:19.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:19.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:19.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:19.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:20.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:20.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:20.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:20.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:21.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:21.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:21.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:21.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:22.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:22.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:22.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:22.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:23.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:23.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:23.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:23.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:24.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:24.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:24.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:24.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:25.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:25.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:25.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:25.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:26.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:26.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:27.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:27.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:27.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:27.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:28.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:28.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:28.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:28.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:29.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:29.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:29.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:29.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:30.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:30.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:30.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:30.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:31.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:31.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:31.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:31.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:32.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:32.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:32.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:32.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:33.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:33.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:33.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:33.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:34.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:34.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:34.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:34.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:35.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:35.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:35.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:35.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:36.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:36.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:36.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:36.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:37.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:37.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:37.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:37.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:38.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:38.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:39.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:39.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:39.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:39.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:40.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:40.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:40.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:40.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:40.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:40.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:40.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:40.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:41.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:41.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:41.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:41.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:42.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:42.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:42.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:42.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:43.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:43.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:44.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:44.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:44.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:44.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:45.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:45.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:45.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:45.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:46.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:46.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:46.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:46.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:47.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:47.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:47.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:47.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:48.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:48.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:48.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:48.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:49.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:49.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:49.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:49.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:50.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:50.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:50.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:50.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:51.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:51.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:51.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:51.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:52.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:52.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:52.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:52.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:53.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:53.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:54.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:54.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:54.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:54.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:55.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:55.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:55.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:55.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:56.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:56.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:56.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:56.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:57.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:57.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:57.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:57.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:58.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:58.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:58.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:58.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:59.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:03:59.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:03:59.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:03:59.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:00.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:00.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:00.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:00.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:01.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:01.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:01.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:01.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:02.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:01.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:02.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:02.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:02.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:02.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:03.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:03.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:03.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:03.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:04.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:04.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:04.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:04.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:05.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:05.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:05.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:05.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:06.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:06.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:06.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:06.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:07.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:07.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:07.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:07.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:08.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:08.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:08.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:08.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:09.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:08.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:09.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:09.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:09.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:09.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:11.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:10.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:11.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:11.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:11.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:11.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:11.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:11.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:12.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:12.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:12.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:12.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:13.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:13.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:13.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:13.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:14.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:14.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:14.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:14.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:15.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:15.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:15.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:15.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:16.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:16.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:16.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:16.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:17.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:17.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:17.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:17.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:18.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:18.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:19.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:19.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:19.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:19.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:19.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:19.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:20.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:20.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:21.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:21.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:21.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:21.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:21.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:21.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:22.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:22.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:23.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:23.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:23.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:23.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:24.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:24.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:24.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:24.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:25.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:25.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:25.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:25.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:26.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:26.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:26.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:26.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:27.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:27.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:28.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:27.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:28.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:28.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:28.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:28.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:29.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:29.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:29.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:29.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:30.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:30.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:30.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:30.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:31.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:31.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:31.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:31.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:32.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:32.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:32.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:32.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:32.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:32.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:33.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:33.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:34.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:34.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:34.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:34.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:35.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:35.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:35.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:35.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:35.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:35.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:36.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:36.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:36.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:36.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:37.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:37.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:37.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:37.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:38.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:38.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:38.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:38.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:39.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:39.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:40.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:40.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:40.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:40.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:41.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:41.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:41.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:41.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:42.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:42.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:43.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:43.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:43.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:43.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:44.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:44.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:44.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:44.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:45.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:45.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:45.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:45.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:46.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:46.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:46.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:46.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:47.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:47.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:47.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:47.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:48.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:48.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:48.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:48.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:49.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:49.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:49.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:49.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:50.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:50.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:50.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:50.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:51.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:51.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:51.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:51.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:52.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:52.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:52.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:52.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:53.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:53.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:53.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:53.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:54.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:54.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:54.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:54.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:55.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:55.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:55.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:55.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:56.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:56.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:56.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:56.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:57.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:57.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:57.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:57.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:58.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:58.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:58.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:58.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:59.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:04:59.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:04:59.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:04:59.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:00.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:00.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:00.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:00.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:01.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:01.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:01.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:01.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:02.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:02.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:02.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:02.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:03.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:03.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:03.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:03.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:04.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:04.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:04.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:04.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:05.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:05.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:05.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:05.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:06.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:06.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:06.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:06.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:07.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:07.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:07.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:07.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:08.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:08.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:08.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:08.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:09.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:09.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:09.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:09.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:10.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:10.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:10.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:10.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:11.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:11.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:11.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:11.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:12.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:12.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:12.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:12.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:13.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:13.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:13.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:13.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:14.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:14.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:14.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:14.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:15.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:15.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:15.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:15.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:16.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:16.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:16.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:16.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:17.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:17.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:17.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:17.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:18.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:18.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:18.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:18.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:19.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:19.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:19.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:19.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:20.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:20.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:20.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:20.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:21.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:21.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:21.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:21.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:22.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:22.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:22.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:22.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:23.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:23.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:23.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:23.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:24.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:24.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:24.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:24.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:25.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:25.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:25.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:25.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:26.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:26.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:26.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:26.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:27.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:27.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:27.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:27.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:28.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:28.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:28.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:28.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:29.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:29.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:29.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:29.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:30.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:30.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:30.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:30.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:31.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:31.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:31.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:31.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:32.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:32.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:32.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:32.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:33.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:33.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:33.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:33.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:34.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:34.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:34.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:34.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:35.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:35.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:35.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:35.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:36.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:36.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:36.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:36.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:37.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:37.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:37.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:37.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:38.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:38.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:38.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:38.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:39.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:39.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:39.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:39.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:40.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:40.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:40.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:40.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:41.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:41.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:41.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:41.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:42.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:42.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:42.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:42.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:43.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:43.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:43.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:43.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:44.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:44.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:44.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:44.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:45.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:45.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:45.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:45.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:46.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:46.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:46.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:46.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:47.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:47.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:47.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:47.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:48.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:48.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:48.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:48.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:49.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:49.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:49.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:49.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:50.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:50.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:50.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:50.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:51.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:51.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:51.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:51.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:52.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:52.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:52.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:52.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:53.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:53.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:53.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:53.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:54.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:54.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:54.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:54.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:55.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:55.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:55.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:55.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:56.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:56.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:56.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:56.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:57.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:57.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:57.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:57.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:58.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:58.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:58.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:58.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:59.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:05:59.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:05:59.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:05:59.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:00.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:00.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:00.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:00.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:01.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:01.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:01.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:01.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:02.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:02.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:02.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:02.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:03.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:03.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:03.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:03.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:04.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:04.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:04.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:04.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:05.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:05.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:05.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:05.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:06.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:06.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:06.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:06.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:07.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:07.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:07.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:07.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:08.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:08.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:08.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:08.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:09.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:09.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:09.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:09.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:09.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:09.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:10.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:10.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:11.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:11.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:11.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:11.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:12.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:11.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:12.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:12.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:13.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:13.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:13.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:13.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:14.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:14.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:14.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:14.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:15.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:15.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:15.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:15.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:16.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:16.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:16.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:16.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:16.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:16.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:17.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:17.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:17.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:17.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:18.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:18.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:19.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:19.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:19.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:19.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:20.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:20.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:20.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:20.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:21.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:21.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:21.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:21.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:22.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:22.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:22.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:22.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:23.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:23.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:23.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:23.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:24.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:24.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:24.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:24.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:25.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:25.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:25.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:25.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:25.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:25.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:26.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:26.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:27.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:27.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:27.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:27.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:28.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:28.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:28.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:28.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:28.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:28.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:29.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:29.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:30.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:30.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:30.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:30.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:31.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:31.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:31.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:31.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:32.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:32.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:32.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:32.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:33.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:33.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:33.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:33.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:34.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:34.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:34.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:34.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:35.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:35.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:35.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:35.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:36.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:36.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:36.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:36.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:37.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:37.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:37.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:37.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:38.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:38.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:38.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:38.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:39.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:39.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:39.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:39.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:40.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:40.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:40.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:40.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:41.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:41.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:41.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:41.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:42.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:42.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:42.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:42.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:43.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:43.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:43.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:43.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:44.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:44.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:44.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:44.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:45.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:45.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:45.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:45.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:46.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:46.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:46.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:46.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:47.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:47.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:47.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:47.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:48.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:48.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:48.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:48.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:49.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:49.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:49.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:49.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:50.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:50.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:50.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:50.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:51.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:51.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:51.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:51.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:52.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:52.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:52.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:52.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:53.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:53.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:53.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:53.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:54.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:54.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:54.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:54.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:55.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:55.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:55.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:55.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:56.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:56.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:56.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:56.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:57.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:57.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:57.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:57.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:58.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:58.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:58.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:58.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:59.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:06:59.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:06:59.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:06:59.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:00.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:00.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:00.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:00.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:01.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:01.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:01.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:01.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:02.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:02.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:02.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:02.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:03.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:03.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:03.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:03.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:04.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:04.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:04.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:04.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:05.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:05.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:05.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:05.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:06.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:06.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:06.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:06.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:07.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:07.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:07.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:07.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:08.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:08.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:08.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:08.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:09.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:09.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:09.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:09.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:10.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:10.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:10.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:10.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:11.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:11.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:11.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:11.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:12.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:12.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:12.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:12.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:13.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:13.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:13.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:13.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:14.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:14.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:14.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:14.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:15.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:15.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:15.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:15.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:16.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:16.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:16.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:16.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:17.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:17.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:17.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:17.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:18.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:18.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:18.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:18.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:19.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:19.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:19.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:19.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:20.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:20.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:20.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:20.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:21.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:21.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:21.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:21.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:22.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:22.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:22.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:22.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:23.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:23.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:23.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:23.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:24.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:24.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:24.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:24.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:25.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:25.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:25.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:25.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:26.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:26.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:26.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:26.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:27.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:27.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:27.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:27.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:28.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:28.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:28.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:28.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:29.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:29.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:29.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:29.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:30.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:30.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:30.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:30.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:31.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:31.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:31.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:31.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:32.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:32.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:32.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:32.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:33.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:33.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:33.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:33.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:34.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:34.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:34.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:34.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:35.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:35.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:35.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:35.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:36.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:36.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:36.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:36.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:37.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:37.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:37.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:37.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:38.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:38.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:38.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:38.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:39.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:39.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:39.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:39.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:40.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:40.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:40.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:40.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:41.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:41.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:41.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:41.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:42.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:42.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:42.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:42.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:43.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:43.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:43.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:43.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:44.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:44.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:44.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:44.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:45.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:45.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:45.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:45.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:46.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:46.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:46.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:46.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:47.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:47.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:47.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:47.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:48.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:48.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:48.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:48.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:49.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:49.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:49.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:49.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:50.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:50.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:50.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:50.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:51.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:51.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:51.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:51.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:52.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:52.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:52.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:52.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:53.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:53.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:53.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:53.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:54.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:54.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:54.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:54.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:55.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:55.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:55.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:55.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:56.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:56.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:56.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:56.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:57.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:57.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:57.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:57.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:58.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:58.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:58.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:58.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:59.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:07:59.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:07:59.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:07:59.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:00.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:00.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:00.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:00.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:01.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:01.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:01.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:01.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:02.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:02.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:02.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:02.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:03.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:03.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:03.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:03.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:04.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:04.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:04.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:04.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:05.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:05.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:05.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:05.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:06.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:06.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:06.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:06.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:07.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:07.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:07.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:07.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:08.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:08.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:08.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:08.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:09.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:09.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:09.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:09.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:10.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:10.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:10.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:10.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:11.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:11.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:11.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:11.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:12.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:12.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:12.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:12.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:13.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:13.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:13.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:13.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:14.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:14.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:14.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:14.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:15.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:15.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:15.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:15.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:16.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:16.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:16.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:16.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:17.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:17.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:17.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:17.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:18.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:18.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:18.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:18.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:19.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:19.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:19.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:19.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:20.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:20.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:20.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:20.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:21.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:21.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:21.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:21.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:22.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:22.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:22.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:22.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:23.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:23.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:23.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:23.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:24.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:24.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:24.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:24.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:25.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:25.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:25.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:25.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:26.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:26.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:26.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:26.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:27.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:27.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:27.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:27.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:28.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:28.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:28.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:28.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:29.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:29.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:29.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:29.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:30.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:30.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:30.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:30.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:31.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:31.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:31.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:31.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:32.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:32.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:32.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:32.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:33.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:33.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:33.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:33.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:34.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:34.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:34.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:34.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:35.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:35.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:35.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:35.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:36.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:36.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:36.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:36.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:37.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:37.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:37.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:37.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:38.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:38.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:38.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:38.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:39.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:39.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:39.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:39.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:40.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:40.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:40.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:40.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:41.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:41.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:41.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:41.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:42.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:42.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:42.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:42.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:43.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:43.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:43.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:43.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:44.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:44.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:44.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:44.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:45.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:45.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:45.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:45.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:46.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:46.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:46.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:46.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:47.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:47.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:47.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:47.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:48.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:48.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:48.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:48.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:49.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:49.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:49.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:49.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:50.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:50.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:50.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:50.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:51.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:51.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:51.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:51.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:52.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:52.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:52.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:52.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:53.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:53.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:53.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:53.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:54.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:54.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:54.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:54.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:55.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:55.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:55.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:55.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:56.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:56.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:56.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:56.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:57.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:57.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:57.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:57.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:58.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:58.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:58.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:58.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:59.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:58.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:59.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:08:59.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:08:59.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:08:59.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:00.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:00.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:00.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:00.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:01.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:01.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:02.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:02.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:02.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:02.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:03.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:03.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:03.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:03.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:04.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:04.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:04.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:04.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:05.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:05.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:05.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:05.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:06.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:06.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:06.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:06.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:07.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:07.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:07.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:07.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:08.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:08.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:08.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:08.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:09.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:09.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:09.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:09.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:10.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:10.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:10.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:10.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:10.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:10.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:11.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:11.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:11.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:11.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:12.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:12.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:13.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:13.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:13.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:13.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:13.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:13.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:14.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:14.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:14.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:14.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:15.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:15.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:15.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:15.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:16.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:16.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:16.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:16.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:17.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:17.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:17.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:17.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:18.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:18.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:18.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:18.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:19.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:19.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:19.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:19.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:20.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:20.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:20.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:20.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:21.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:21.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:21.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:21.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:22.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:22.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:22.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:22.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:23.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:23.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:23.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:23.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:24.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:24.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:24.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:24.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:25.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:25.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:25.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:25.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:26.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:26.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:26.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:26.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:27.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:27.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:27.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:27.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:28.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:28.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:28.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:28.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:29.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:29.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:29.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:29.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:30.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:30.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:30.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:30.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:31.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:31.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:31.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:31.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:32.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:32.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:32.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:32.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:33.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:33.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:33.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:33.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:34.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:34.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:34.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:34.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:35.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:35.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:35.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:35.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:36.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:36.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:36.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:36.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:37.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:37.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:37.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:37.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:38.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:38.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:38.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:38.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:39.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:39.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:39.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:39.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:40.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:40.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:40.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:40.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:41.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:41.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:41.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:41.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:42.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:42.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:42.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:42.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:43.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:43.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:43.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:43.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:44.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:44.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:44.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:44.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:46.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:46.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:46.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:46.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:46.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:46.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:47.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:47.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:48.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:48.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:48.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:48.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:49.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:49.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:49.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:49.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:50.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:50.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:50.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:50.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:51.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:51.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:51.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:51.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:52.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:52.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:52.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:52.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:53.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:53.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:53.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:53.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:54.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:53.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:54.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:54.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:54.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:54.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:55.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:55.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:56.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:56.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:56.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:56.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:57.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:57.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:57.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:57.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:58.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:58.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:58.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:58.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:59.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:09:59.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:09:59.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:09:59.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:00.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:00.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:00.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:00.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:01.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:01.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:01.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:01.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:02.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:02.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:02.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:02.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:03.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:03.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:03.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:03.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:04.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:04.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:04.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:04.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:05.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:05.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:05.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:05.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:06.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:06.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:06.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:06.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:07.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:07.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:07.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:07.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:08.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:08.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:08.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:08.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:09.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:09.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:09.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:09.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:10.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:10.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:10.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:10.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:11.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:11.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:11.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:11.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:12.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:12.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:12.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:12.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:13.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:13.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:13.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:13.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:14.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:14.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:14.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:14.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:15.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:15.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:15.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:15.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:16.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:16.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:16.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:16.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:16.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:16.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:17.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:17.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:17.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:17.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:18.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:18.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:19.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:19.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:19.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:19.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:20.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:20.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:20.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:20.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:21.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:21.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:21.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:21.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:22.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:22.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:22.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:22.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:23.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:23.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:23.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:23.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:24.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:24.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:24.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:24.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:25.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:25.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:25.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:25.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:26.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:26.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:26.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:26.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:27.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:27.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:27.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:27.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:28.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:28.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:28.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:28.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:29.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:29.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:29.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:29.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:30.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:30.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:30.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:30.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:31.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:31.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:31.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:31.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:32.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:32.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:32.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:32.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:33.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:33.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:33.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:33.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:34.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:34.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:34.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:34.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:35.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:35.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:35.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:35.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:36.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:36.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:36.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:36.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:37.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:37.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:37.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:37.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:38.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:38.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:38.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:38.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:39.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:39.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:39.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:39.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:40.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:40.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:40.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:40.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:41.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:41.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:41.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:41.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:42.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:42.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:42.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:42.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:43.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:43.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:43.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:43.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:44.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:44.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:44.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:44.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:45.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:45.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:45.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:45.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:46.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:46.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:46.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:46.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:47.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:47.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:47.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:47.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:48.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:48.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:48.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:48.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:49.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:49.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:49.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:49.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:50.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:50.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:50.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:50.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:51.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:51.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:51.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:51.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:52.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:52.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:52.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:52.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:53.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:53.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:53.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:53.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:54.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:54.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:54.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:54.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:55.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:55.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:55.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:55.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:56.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:56.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:56.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:56.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:57.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:57.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:57.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:57.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:58.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:58.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:58.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:58.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:58.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:58.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:59.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:10:59.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:10:59.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:10:59.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:00.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:00.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:00.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:00.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:01.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:01.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:01.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:01.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:02.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:02.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:02.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:02.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:03.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:03.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:03.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:03.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:04.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:04.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:04.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:04.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:05.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:05.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:05.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:05.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:06.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:06.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:06.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:06.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:07.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:07.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:08.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:08.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:08.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:08.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:08.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:08.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:09.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:09.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:10.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:09.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:10.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:10.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:10.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:10.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:11.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:11.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:11.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:11.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:12.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:12.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:12.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:12.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:13.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:13.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:13.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:13.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:14.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:14.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:14.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:14.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:15.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:15.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:15.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:15.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:16.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:16.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:16.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:16.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:17.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:17.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:17.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:17.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:18.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:18.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:18.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:18.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:19.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:19.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:19.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:19.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:20.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:20.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:20.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:20.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:21.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:21.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:21.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:21.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:22.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:22.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:22.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:22.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:23.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:23.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:24.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:24.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:24.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:24.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:25.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:25.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:25.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:25.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:26.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:26.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:26.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:26.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:27.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:27.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:27.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:27.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:27.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:27.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:28.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:28.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:28.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:28.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:29.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:29.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:29.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:29.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:30.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:30.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:30.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:30.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:31.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:31.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:32.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:32.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:32.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:32.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:33.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:33.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:33.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:33.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:33.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:33.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:34.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:34.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:35.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:35.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:35.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:35.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:36.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:36.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:36.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:36.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:37.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:37.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:37.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:37.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:38.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:38.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:38.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:38.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:39.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:39.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:39.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:39.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:40.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:40.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:40.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:40.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:41.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:41.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:41.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:41.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:42.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:42.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:42.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:42.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:43.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:43.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:43.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:43.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:44.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:44.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:44.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:44.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:45.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:45.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:45.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:45.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:46.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:46.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:46.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:46.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:47.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:47.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:47.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:47.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:48.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:48.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:48.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:48.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:49.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:49.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:49.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:49.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:50.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:50.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:50.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:50.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:51.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:51.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:51.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:51.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:52.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:52.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:52.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:52.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:53.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:53.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:53.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:53.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:54.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:54.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:54.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:54.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:55.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:55.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:55.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:55.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:56.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:56.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:56.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:56.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:57.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:57.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:57.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:57.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:58.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:58.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:58.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:58.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:59.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:11:59.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:11:59.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:11:59.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:00.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:00.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:00.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:00.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:01.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:01.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:01.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:01.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:02.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:02.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:02.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:02.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:03.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:03.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:03.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:03.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:04.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:04.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:04.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:04.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:05.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:05.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:05.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:05.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:06.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:06.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:06.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:06.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:07.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:07.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:07.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:07.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:08.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:08.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:08.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:08.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:09.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:09.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:09.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:09.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:10.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:10.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:10.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:10.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:11.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:11.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:11.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:11.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:12.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:12.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:12.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:12.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:13.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:13.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:13.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:13.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:14.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:14.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:14.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:14.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:15.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:15.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:15.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:15.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:16.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:16.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:16.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:16.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:17.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:17.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:17.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:17.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:18.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:18.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:18.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:18.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:19.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:19.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:19.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:19.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:20.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:20.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:20.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:20.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:21.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:21.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:21.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:21.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:22.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:22.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:22.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:22.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:23.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:23.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:23.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:23.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:24.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:24.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:24.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:24.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:25.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:25.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:25.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:25.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:26.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:26.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:26.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:26.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:27.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:27.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:27.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:27.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:28.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:28.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:28.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:28.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:29.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:29.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:29.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:29.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:30.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:30.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:30.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:30.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:31.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:31.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:31.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:31.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:32.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:32.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:32.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:32.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:33.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:33.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:33.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:33.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:34.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:34.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:34.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:34.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:35.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:35.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:35.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:35.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:36.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:36.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:36.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:36.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:37.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:37.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:37.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:37.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:38.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:38.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:38.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:39.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:39.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:39.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:39.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:40.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:40.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:40.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:40.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:41.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:41.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:41.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:41.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:42.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:42.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:42.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:42.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:43.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:43.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:43.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:43.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:44.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:44.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:44.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:44.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:45.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:45.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:45.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:45.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:46.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:46.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:46.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:46.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:47.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:47.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:47.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:47.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:48.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:48.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:48.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:48.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:49.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:49.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:49.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:49.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:50.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:50.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:50.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:50.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:51.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:51.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:51.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:51.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:52.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:52.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:52.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:52.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:53.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:53.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:53.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:53.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:54.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:54.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:54.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:54.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:55.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:55.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:55.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:55.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:56.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:56.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:56.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:56.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:57.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:57.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:57.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:57.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:58.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:58.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:58.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:58.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:59.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:12:59.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:12:59.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:12:59.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:00.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:00.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:00.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:00.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:01.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:01.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:01.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:01.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:02.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:02.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:02.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:02.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:03.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:03.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:03.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:03.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:04.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:04.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:04.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:04.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:05.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:05.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:05.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:05.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:06.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:06.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:06.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:06.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:07.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:07.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:07.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:07.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:08.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:08.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:08.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:08.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:09.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:09.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:09.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:09.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:10.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:10.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:10.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:10.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:11.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:11.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:11.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:11.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:12.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:12.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:12.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:12.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:13.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:13.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:13.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:13.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:14.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:14.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:14.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:14.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:15.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:15.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:15.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:15.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:16.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:16.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:16.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:16.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:17.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:17.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:17.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:17.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:18.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:18.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:18.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:18.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:19.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:19.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:19.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:19.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:20.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:20.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:20.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:20.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:21.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:21.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:21.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:21.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:22.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:22.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:22.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:22.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:23.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:23.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:23.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:23.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:24.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:24.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:24.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:24.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:25.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:25.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:25.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:25.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:26.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:26.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:26.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:26.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:27.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:27.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:27.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:27.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:28.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:28.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:28.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:28.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:29.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:29.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:29.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:29.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:30.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:30.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:30.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:30.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:31.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:31.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:31.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:31.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:32.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:32.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:32.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:32.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:33.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:33.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:33.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:33.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:34.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:34.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:34.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:34.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:35.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:35.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:35.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:35.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:36.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:36.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:36.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:36.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:37.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:37.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:37.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:37.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:38.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:38.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:38.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:38.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:39.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:39.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:39.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:39.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:40.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:40.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:40.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:40.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:41.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:41.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:41.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:41.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:42.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:42.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:42.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:42.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:43.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:43.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:43.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:43.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:44.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:44.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:44.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:44.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:45.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:45.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:45.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:45.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:46.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:46.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:46.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:46.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:47.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:47.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:47.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:47.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:48.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:48.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:48.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:48.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:49.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:49.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:49.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:49.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:50.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:50.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:50.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:50.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:51.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:51.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:51.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:51.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:52.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:52.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:52.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:52.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:53.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:53.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:53.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:53.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:54.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:54.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:54.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:54.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:55.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:55.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:55.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:55.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:56.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:56.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:56.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:56.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:57.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:57.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:57.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:57.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:58.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:58.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:58.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:58.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:59.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:13:59.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:13:59.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:13:59.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:00.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:00.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:00.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:00.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:01.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:01.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:01.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:01.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:02.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:02.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:02.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:02.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:03.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:03.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:03.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:03.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:04.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:04.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:04.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:04.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:05.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:05.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:05.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:05.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:06.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:06.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:06.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:06.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:07.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:07.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:07.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:07.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:08.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:08.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:08.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:08.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:09.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:09.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:09.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:09.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:10.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:10.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:10.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:10.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:11.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:11.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:12.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:12.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:12.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:12.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:13.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:13.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:13.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:13.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:14.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:14.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:14.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:14.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:15.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:15.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:15.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:15.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:16.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:16.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:16.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:16.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:17.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:17.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:17.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:17.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:18.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:18.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:18.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:18.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:19.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:19.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:19.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:19.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:20.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:20.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:20.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:20.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:21.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:21.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:21.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:21.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:22.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:22.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:22.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:22.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:23.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:23.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:23.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:23.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:24.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:24.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:24.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:24.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:25.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:25.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:25.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:25.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:26.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:26.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:26.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:26.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:27.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:27.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:27.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:27.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:28.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:28.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:28.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:28.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:29.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:29.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:29.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:29.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:30.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:30.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:30.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:30.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:31.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:31.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:31.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:31.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:32.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:32.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:32.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:32.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:33.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:33.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:33.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:33.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:34.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:34.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:34.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:34.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:35.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:35.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:35.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:35.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:36.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:36.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:36.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:36.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:37.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:37.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:37.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:37.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:38.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:38.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:38.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:38.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:39.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:39.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:39.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:39.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:40.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:40.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:40.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:40.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:41.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:41.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:41.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:41.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:42.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:42.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:42.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:42.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:43.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:43.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:43.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:43.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:44.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:44.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:44.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:44.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:45.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:45.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:45.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:45.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:46.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:46.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:46.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:46.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:47.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:47.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:47.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:47.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:48.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:48.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:48.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:48.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:49.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:49.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:49.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:49.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:50.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:50.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:50.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:50.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:51.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:51.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:51.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:51.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:52.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:52.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:52.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:52.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:53.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:53.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:53.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:53.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:54.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:54.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:54.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:54.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:55.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:55.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:55.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:55.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:56.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:56.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:56.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:56.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:57.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:57.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:57.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:57.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:58.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:58.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:58.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:58.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:14:59.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:14:59.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:00.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:14:59.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:00.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:00.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:00.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:01.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:01.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:01.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:01.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:02.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:02.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:02.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:02.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:03.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:03.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:03.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:03.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:04.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:04.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:04.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:04.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:05.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:05.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:05.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:05.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:06.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:06.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:06.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:06.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:07.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:07.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:07.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:07.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:08.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:08.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:08.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:08.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:09.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:09.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:09.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:09.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:10.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:10.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:10.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:10.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:11.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:11.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:11.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:11.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:12.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:12.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:12.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:12.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:13.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:13.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:13.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:13.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:14.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:14.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:14.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:14.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:15.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:15.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:16.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:16.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:16.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:16.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:17.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:17.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:17.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:17.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:18.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:18.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:18.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:18.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:19.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:19.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:19.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:19.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:20.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:20.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:20.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:20.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:21.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:21.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:21.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:21.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:22.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:22.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:22.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:22.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:22.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:22.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:23.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:23.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:24.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:24.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:24.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:24.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:25.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:25.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:25.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:25.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:26.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:26.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:26.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:26.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:27.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:27.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:27.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:27.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:28.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:28.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:28.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:28.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:29.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:29.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:29.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:29.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:30.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:30.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:30.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:30.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:31.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:31.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:31.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:31.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:32.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:32.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:32.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:32.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:33.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:33.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:33.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:33.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:34.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:34.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:34.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:34.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:35.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:35.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:35.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:35.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:36.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:36.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:36.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:36.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:37.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:37.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:37.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:37.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:38.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:38.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:38.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:38.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:39.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:39.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:39.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:39.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:40.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:40.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:40.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:40.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:41.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:41.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:41.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:41.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:42.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:42.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:42.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:42.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:43.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:43.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:43.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:43.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:44.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:44.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:44.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:44.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:45.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:45.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:45.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:45.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:46.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:46.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:46.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:46.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:47.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:47.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:47.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:47.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:48.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:48.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:48.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:48.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:49.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:49.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:49.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:49.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:50.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:50.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:50.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:50.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:51.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:51.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:51.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:51.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:52.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:52.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:52.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:52.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:53.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:53.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:53.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:53.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:54.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:54.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:54.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:54.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:55.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:55.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:55.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:55.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:56.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:56.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:56.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:56.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:57.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:57.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:57.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:57.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:58.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:58.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:58.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:58.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:59.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:15:59.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:15:59.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:15:59.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:00.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:00.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:00.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:00.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:01.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:01.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:01.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:01.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:02.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:02.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:02.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:02.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:03.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:03.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:03.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:03.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:04.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:04.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:04.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:04.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:05.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:05.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:05.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:05.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:06.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:06.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:06.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:06.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:07.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:07.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:07.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:07.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:08.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:08.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:08.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:08.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:09.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:09.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:09.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:09.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:10.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:10.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:10.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:10.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:11.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:11.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:11.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:11.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:12.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:12.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:12.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:12.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:13.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:13.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:13.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:13.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:14.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:14.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:14.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:14.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:15.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:15.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:15.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:15.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:16.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:16.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:16.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:16.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:17.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:17.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:17.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:17.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:18.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:18.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:18.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:18.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:19.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:19.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:19.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:19.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:20.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:20.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:20.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:20.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:21.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:21.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:21.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:21.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:22.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:22.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:22.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:22.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:23.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:23.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:23.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:23.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:24.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:24.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:24.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:24.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:25.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:25.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:25.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:25.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:26.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:26.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:26.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:26.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:27.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:27.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:27.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:27.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:28.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:28.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:28.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:28.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:29.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:29.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:29.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:29.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:30.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:30.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:30.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:30.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:31.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:31.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:31.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:31.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:32.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:32.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:32.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:32.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:33.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:33.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:33.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:33.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:34.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:34.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:34.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:34.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:35.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:35.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:35.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:35.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:36.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:36.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:36.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:36.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:37.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:37.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:37.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:37.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:38.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:38.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:38.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:38.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:39.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:39.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:39.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:39.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:40.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:40.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:40.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:40.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:41.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:41.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:41.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:41.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:42.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:42.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:42.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:42.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:43.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:43.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:43.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:43.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:44.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:44.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:44.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:44.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:45.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:45.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:45.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:45.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:46.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:46.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:46.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:46.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:47.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:47.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:47.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:47.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:48.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:48.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:48.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:48.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:49.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:49.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:49.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:49.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:50.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:50.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:50.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:50.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:51.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:51.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:51.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:51.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:52.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:52.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:52.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:52.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:53.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:53.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:53.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:53.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:54.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:54.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:54.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:54.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:55.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:55.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:55.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:55.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:56.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:56.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:56.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:56.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:57.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:57.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:57.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:57.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:58.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:58.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:58.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:58.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:59.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:16:59.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:16:59.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:16:59.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:00.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:00.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:00.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:00.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:01.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:01.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:01.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:01.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:02.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:02.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:02.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:02.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:03.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:03.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:03.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:03.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:04.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:04.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:04.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:04.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:05.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:05.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:05.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:05.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:06.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:06.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:06.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:06.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:07.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:07.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:07.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:07.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:08.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:08.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:08.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:08.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:09.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:09.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:09.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:09.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:10.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:10.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:10.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:10.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:11.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:11.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:11.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:11.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:12.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:12.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:12.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:12.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:13.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:13.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:13.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:13.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:14.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:14.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:14.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:14.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:15.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:15.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:15.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:15.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:16.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:16.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:16.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:16.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:17.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:17.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:17.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:17.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:18.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:18.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:18.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:18.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:19.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:19.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:19.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:19.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:20.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:20.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:20.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:20.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:21.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:21.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:21.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:21.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:22.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:22.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:22.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:22.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:23.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:23.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:23.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:23.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:24.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:24.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:24.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:24.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:25.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:25.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:25.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:25.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:26.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:26.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:26.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:26.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:27.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:27.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:27.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:27.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:28.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:28.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:28.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:28.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:29.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:29.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:29.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:29.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:30.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:30.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:30.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:30.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:31.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:31.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:31.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:31.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:32.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:32.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:32.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:32.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:33.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:33.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:33.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:33.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:34.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:34.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:34.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:34.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:35.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:35.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:35.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:35.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:36.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:36.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:36.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:36.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:37.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:37.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:37.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:37.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:38.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:38.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:38.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:38.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:39.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:39.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:39.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:39.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:40.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:40.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:40.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:40.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:41.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:41.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:41.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:41.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:42.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:42.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:42.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:42.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:43.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:43.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:43.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:43.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:44.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:44.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:44.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:44.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:45.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:45.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:45.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:45.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:46.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:46.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:46.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:46.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:47.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:47.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:47.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:47.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:48.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:48.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:48.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:48.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:49.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:49.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:49.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:49.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:50.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:50.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:50.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:50.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:51.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:51.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:51.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:51.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:52.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:52.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:52.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:52.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:53.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:53.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:53.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:53.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:54.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:54.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:54.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:54.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:55.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:55.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:55.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:55.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:56.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:56.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:56.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:56.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:57.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:57.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:57.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:57.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:58.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:58.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:58.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:58.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:59.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:17:59.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:17:59.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:17:59.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:00.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:00.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:00.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:00.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:01.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:01.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:01.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:01.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:02.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:02.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:02.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:02.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:03.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:03.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:03.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:03.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:04.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:04.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:04.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:04.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:05.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:05.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:05.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:05.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:06.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:06.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:06.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:06.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:07.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:07.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:07.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:07.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:08.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:08.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:08.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:08.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:09.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:09.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:09.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:09.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:10.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:10.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:10.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:10.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:11.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:11.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:11.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:11.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:12.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:12.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:12.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:12.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:13.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:13.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:13.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:13.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:14.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:14.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:14.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:14.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:15.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:15.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:15.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:15.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:16.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:16.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:16.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:16.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:17.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:17.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:17.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:17.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:18.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:18.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:18.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:18.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:19.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:19.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:19.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:19.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:20.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:20.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:20.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:20.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:21.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:21.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:21.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:21.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:22.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:22.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:22.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:22.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:23.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:23.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:23.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:23.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:24.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:24.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:24.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:24.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:25.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:25.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:25.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:25.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:26.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:26.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:26.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:26.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:27.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:27.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:27.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:27.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:28.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:28.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:28.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:28.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:29.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:29.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:29.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:29.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:30.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:30.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:30.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:30.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:31.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:31.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:31.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:31.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:32.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:32.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:32.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:32.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:33.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:33.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:33.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:33.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:34.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:34.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:34.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:34.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:35.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:35.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:35.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:35.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:36.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:36.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:36.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:36.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:37.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:37.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:37.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:37.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:38.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:38.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:38.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:38.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:39.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:39.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:39.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:39.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:40.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:40.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:40.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:40.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:41.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:41.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:41.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:41.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:42.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:42.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:42.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:42.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:43.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:43.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:43.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:43.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:44.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:44.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:44.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:44.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:45.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:45.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:45.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:45.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:46.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:46.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:46.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:46.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:47.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:47.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:47.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:47.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:48.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:48.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:48.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:48.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:49.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:49.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:49.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:49.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:50.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:50.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:50.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:50.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:51.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:51.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:51.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:51.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:52.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:52.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:52.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:52.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:53.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:53.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:53.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:53.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:54.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:54.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:54.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:54.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:55.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:55.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:55.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:55.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:56.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:56.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:56.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:56.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:57.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:57.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:57.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:57.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:58.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:58.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:58.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:58.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:59.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:18:59.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:18:59.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:18:59.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:00.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:00.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:00.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:00.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:01.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:01.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:01.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:01.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:02.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:02.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:02.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:02.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:03.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:03.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:03.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:03.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:04.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:04.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:04.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:04.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:05.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:05.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:05.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:05.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:06.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:06.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:06.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:06.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:07.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:07.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:07.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:07.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:08.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:08.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:08.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:08.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:09.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:09.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:09.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:09.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:10.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:10.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:10.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:10.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:11.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:11.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:11.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:11.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:12.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:12.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:12.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:12.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:13.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:13.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:13.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:13.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:14.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:14.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:14.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:14.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:15.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:15.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:15.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:15.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:16.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:16.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:16.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:16.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:17.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:17.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:17.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:17.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:18.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:18.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:18.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:18.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:19.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:19.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:19.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:19.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:20.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:20.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:20.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:20.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:21.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:21.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:21.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:21.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:22.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:22.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:22.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:22.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:23.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:23.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:23.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:23.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:24.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:24.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:24.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:24.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:25.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:25.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:25.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:25.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:26.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:26.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:26.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:26.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:27.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:27.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:27.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:27.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:28.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:28.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:28.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:28.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:29.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:29.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:29.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:29.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:30.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:30.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:30.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:30.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:31.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:31.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:31.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:31.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:32.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:32.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:32.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:32.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:33.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:33.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:33.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:33.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:34.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:34.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:34.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:34.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:35.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:35.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:35.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:35.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:36.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:36.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:36.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:36.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:37.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:37.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:37.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:37.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:38.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:38.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:38.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:38.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:39.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:39.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:39.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:39.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:40.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:40.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:40.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:40.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:41.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:41.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:41.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:41.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:42.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:42.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:42.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:42.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:43.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:43.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:43.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:43.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:44.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:44.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:44.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:44.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:45.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:45.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:45.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:45.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:46.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:46.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:46.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:46.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:47.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:47.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:47.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:47.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:48.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:48.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:48.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:48.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:49.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:49.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:49.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:49.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:50.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:50.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:50.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:50.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:51.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:51.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:51.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:51.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:52.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:52.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:52.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:52.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:53.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:53.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:53.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:53.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:54.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:54.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:54.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:54.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:55.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:55.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:55.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:55.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:56.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:56.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:56.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:56.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:57.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:57.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:57.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:57.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:58.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:58.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:58.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:58.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:59.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:19:59.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:19:59.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:19:59.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:00.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:00.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:00.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:00.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:01.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:01.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:01.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:01.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:02.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:02.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:02.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:02.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:03.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:03.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:03.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:03.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:04.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:04.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:04.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:04.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:05.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:05.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:05.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:05.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:06.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:06.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:06.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:06.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:07.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:07.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:07.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:07.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:08.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:08.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:08.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:08.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:09.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:09.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:09.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:09.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:10.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:10.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:10.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:10.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:11.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:11.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:11.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:11.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:12.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:12.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:12.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:12.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:13.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:13.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:13.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:13.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:14.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:14.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:14.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:14.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:15.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:15.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:15.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:15.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:16.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:16.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:16.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:16.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:17.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:17.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:17.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:17.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:18.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:18.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:18.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:18.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:19.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:19.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:19.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:19.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:20.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:20.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:20.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:20.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:21.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:21.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:21.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:21.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:22.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:22.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:22.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:22.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:23.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:23.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:23.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:23.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:24.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:24.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:24.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:24.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:25.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:25.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:25.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:25.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:26.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:26.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:26.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:26.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:27.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:27.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:27.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:27.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:28.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:28.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:28.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:28.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:29.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:29.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:29.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:29.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:30.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:30.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:30.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:30.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:31.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:31.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:31.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:31.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:32.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:32.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:32.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:32.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:33.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:33.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:33.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:33.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:34.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:34.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:34.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:34.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:35.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:35.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:35.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:35.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:36.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:36.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:36.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:36.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:37.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:37.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:37.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:37.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:38.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:38.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:38.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:38.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:39.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:39.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:39.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:39.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:40.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:40.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:40.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:40.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:41.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:41.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:41.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:41.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:42.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:42.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:42.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:42.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:43.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:43.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:43.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:43.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:44.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:44.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:44.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:44.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:45.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:45.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:45.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:45.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:46.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:46.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:47.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:47.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:47.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:47.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:48.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:48.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:48.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:48.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:49.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:49.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:49.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:49.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:49.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:49.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:50.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:50.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:51.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:51.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:51.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:51.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:51.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:51.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:52.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:52.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:53.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:53.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:53.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:53.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:54.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:54.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:54.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:54.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:55.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:55.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:55.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:55.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:56.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:56.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:56.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:56.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:57.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:57.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:57.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:57.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:58.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:58.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:58.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:58.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:59.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:20:59.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:20:59.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:20:59.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:00.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:00.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:00.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:00.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:01.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:01.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:01.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:01.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:02.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:02.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:02.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:02.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:03.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:03.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:03.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:03.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:04.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:04.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:04.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:04.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:05.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:05.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:05.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:05.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:06.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:06.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:06.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:06.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:07.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:07.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:07.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:07.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:08.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:08.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:08.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:08.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:09.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:09.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:09.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:09.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:10.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:10.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:10.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:10.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:11.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:11.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:11.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:11.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:12.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:12.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:12.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:12.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:13.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:13.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:13.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:13.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:14.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:14.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:14.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:14.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:15.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:15.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:15.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:15.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:16.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:16.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:16.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:16.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:17.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:17.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:17.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:17.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:18.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:18.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:18.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:18.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:19.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:19.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:19.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:19.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:20.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:20.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:20.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:20.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:21.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:21.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:21.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:21.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:22.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:22.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:22.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:22.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:23.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:23.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:23.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:23.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:24.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:24.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:24.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:24.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:25.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:25.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:25.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:25.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:26.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:26.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:26.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:26.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:27.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:27.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:27.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:27.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:28.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:28.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:28.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:28.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:29.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:29.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:29.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:29.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:30.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:30.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:30.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:30.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:31.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:31.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:31.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:31.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:32.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:32.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:32.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:32.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:33.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:33.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:33.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:33.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:34.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:34.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:34.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:34.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:35.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:35.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:35.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:35.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:36.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:36.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:36.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:36.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:37.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:37.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:37.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:37.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:38.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:38.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:38.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:38.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:39.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:39.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:39.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:39.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:40.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:40.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:40.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:40.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:41.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:41.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:41.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:41.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:42.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:42.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:42.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:42.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:43.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:43.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:43.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:43.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:44.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:44.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:44.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:44.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:45.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:45.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:45.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:45.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:46.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:46.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:46.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:46.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:47.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:47.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:47.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:47.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:48.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:48.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:48.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:48.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:49.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:49.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:49.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:49.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:50.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:50.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:50.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:50.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:51.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:51.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:51.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:51.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:52.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:52.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:52.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:52.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:53.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:53.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:53.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:53.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:54.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:54.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:54.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:54.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:55.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:55.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:55.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:55.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:56.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:56.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:56.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:56.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:57.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:57.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:57.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:57.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:58.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:58.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:58.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:58.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:59.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:21:59.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:21:59.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:21:59.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:00.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:00.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:00.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:00.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:01.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:01.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:01.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:01.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:02.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:02.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:02.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:02.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:03.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:03.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:03.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:03.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:04.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:04.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:04.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:04.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:05.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:05.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:05.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:05.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:06.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:06.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:06.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:06.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:07.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:07.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:07.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:07.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:08.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:08.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:08.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:08.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:09.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:09.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:09.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:09.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:10.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:10.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:10.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:10.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:11.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:11.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:11.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:11.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:12.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:12.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:12.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:12.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:13.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:13.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:13.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:13.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:14.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:14.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:14.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:14.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:15.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:15.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:15.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:15.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:16.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:16.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:16.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:16.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:17.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:17.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:17.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:17.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:18.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:18.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:18.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:19.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:19.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:19.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:19.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:20.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:20.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:20.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:20.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:21.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:21.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:21.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:21.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:22.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:22.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:22.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:22.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:23.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:23.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:23.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:23.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:24.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:24.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:24.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:24.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:25.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:25.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:25.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:25.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:26.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:26.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:26.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:26.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:27.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:27.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:27.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:27.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:28.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:28.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:28.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:28.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:29.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:29.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:29.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:29.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:30.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:30.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:30.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:30.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:31.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:31.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:31.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:31.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:32.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:32.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:32.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:32.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:33.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:33.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:33.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:33.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:34.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:34.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:34.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:34.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:35.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:35.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:35.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:35.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:36.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:36.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:36.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:36.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:37.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:37.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:37.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:37.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:38.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:38.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:38.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:38.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:39.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:39.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:39.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:39.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:40.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:40.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:40.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:40.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:41.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:41.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:41.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:41.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:42.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:42.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:42.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:42.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:43.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:43.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:43.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:43.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:44.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:44.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:44.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:44.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:45.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:45.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:45.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:45.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:46.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:46.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:46.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:46.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:47.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:47.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:47.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:47.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:48.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:48.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:48.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:48.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:49.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:49.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:49.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:49.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:50.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:50.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:50.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:50.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:51.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:51.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:51.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:51.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:52.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:52.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:52.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:52.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:53.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:53.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:53.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:53.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:54.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:54.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:54.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:54.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:55.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:55.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:55.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:55.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:56.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:56.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:56.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:56.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:57.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:57.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:57.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:57.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:58.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:58.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:58.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:58.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:59.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:22:59.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:22:59.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:22:59.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:00.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:00.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:00.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:00.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:01.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:01.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:01.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:01.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:02.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:02.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:02.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:02.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:03.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:03.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:03.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:03.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:04.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:04.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:04.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:04.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:05.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:05.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:05.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:05.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:06.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:06.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:06.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:06.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:07.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:07.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:07.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:07.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:08.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:08.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:08.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:08.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:09.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:09.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:09.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:09.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:10.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:10.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:10.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:10.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:11.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:11.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:11.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:11.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:12.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:12.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:12.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:12.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:13.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:13.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:13.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:13.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:14.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:14.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:14.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:14.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:15.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:15.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:15.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:15.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:16.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:16.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:16.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:16.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:17.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:17.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:17.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:17.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:18.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:18.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:18.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:18.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:19.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:19.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:19.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:19.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:20.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:20.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:20.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:20.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:21.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:21.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:21.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:21.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:22.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:22.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:22.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:22.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:23.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:23.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:23.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:23.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:24.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:24.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:24.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:24.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:25.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:25.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:25.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:25.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:26.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:26.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:26.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:26.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:27.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:27.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:27.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:27.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:28.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:28.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:28.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:28.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:29.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:29.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:29.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:29.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:30.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:30.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:30.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:30.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:31.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:31.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:31.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:31.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:32.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:32.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:32.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:32.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:33.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:33.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:33.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:33.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:34.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:34.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:34.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:34.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:35.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:35.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:35.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:35.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:36.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:36.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:36.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:36.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:37.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:37.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:37.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:37.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:38.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:38.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:38.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:38.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:39.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:39.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:39.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:39.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:40.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:40.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:40.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:40.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:41.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:41.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:41.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:41.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:42.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:42.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:42.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:42.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:43.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:43.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:43.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:43.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:44.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:44.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:44.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:44.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:45.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:45.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:45.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:45.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:46.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:46.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:46.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:46.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:47.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:47.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:47.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:47.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:48.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:48.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:48.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:48.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:49.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:49.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:49.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:49.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:50.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:50.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:50.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:50.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:51.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:51.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:51.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:51.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:52.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:52.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:52.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:52.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:53.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:53.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:53.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:53.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:54.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:54.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:54.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:54.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:55.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:55.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:55.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:55.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:56.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:56.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:56.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:56.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:57.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:57.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:57.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:57.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:58.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:58.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:58.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:58.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:59.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:23:59.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:23:59.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:23:59.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:00.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:00.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:00.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:00.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:01.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:01.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:01.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:01.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:02.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:02.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:02.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:02.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:03.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:03.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:03.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:03.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:04.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:04.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:04.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:04.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:05.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:05.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:05.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:05.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:06.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:06.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:06.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:06.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:07.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:07.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:07.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:07.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:08.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:08.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:08.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:08.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:09.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:09.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:09.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:09.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:10.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:10.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:11.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:11.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:11.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:11.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:11.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:11.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:12.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:12.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:12.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:12.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:13.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:13.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:13.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:13.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:14.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:14.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:14.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:14.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:15.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:15.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:15.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:15.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:16.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:16.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:16.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:16.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:17.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:17.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:17.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:17.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:18.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:18.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:18.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:18.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:19.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:19.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:19.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:19.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:20.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:20.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:20.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:20.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:21.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:21.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:21.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:21.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:22.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:22.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:22.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:22.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:23.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:23.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:23.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:23.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:24.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:24.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:24.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:24.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:25.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:25.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:25.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:25.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:26.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:26.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:26.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:26.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:27.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:27.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:27.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:27.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:28.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:28.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:28.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:28.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:29.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:29.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:29.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:29.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:30.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:30.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:30.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:30.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:31.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:31.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:32.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:31.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:32.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:32.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:33.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:32.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:33.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:33.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:34.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:34.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:34.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:34.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:35.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:35.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:35.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:35.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:36.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:36.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:36.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:36.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:37.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:37.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:37.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:37.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:38.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:38.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:38.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:38.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:39.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:39.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:39.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:39.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:40.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:40.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:40.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:40.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:41.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:41.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:41.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:41.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:42.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:42.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:42.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:42.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:43.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:43.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:43.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:43.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:44.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:44.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:44.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:44.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:45.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:45.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:45.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:45.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:46.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:46.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:46.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:46.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:47.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:47.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:47.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:47.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:48.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:48.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:48.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:48.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:49.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:49.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:49.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:49.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:50.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:50.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:50.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:50.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:51.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:51.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:51.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:51.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:51.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:51.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:52.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:52.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:52.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:52.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:53.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:53.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:53.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:53.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:54.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:54.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:55.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:55.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:55.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:55.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:56.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:56.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:56.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:56.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:56.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:56.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:57.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:57.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:57.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:57.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:58.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:58.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:59.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:24:59.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:24:59.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:24:59.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:00.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:00.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:00.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:00.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:01.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:01.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:01.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:01.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:02.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:02.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:02.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:02.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:03.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:03.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:03.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:03.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:04.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:04.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:04.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:04.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:05.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:05.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:05.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:05.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:06.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:06.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:06.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:06.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:07.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:07.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:07.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:07.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:08.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:08.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:08.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:08.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:09.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:09.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:09.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:09.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:10.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:10.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:10.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:10.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:11.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:11.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:11.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:11.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:12.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:12.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:12.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:12.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:13.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:13.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:13.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:13.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:14.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:14.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:14.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:14.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:15.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:15.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:15.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:15.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:16.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:16.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:16.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:16.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:17.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:17.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:17.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:17.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:18.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:18.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:18.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:18.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:19.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:19.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:19.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:19.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:20.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:20.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:20.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:20.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:21.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:21.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:21.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:21.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:22.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:22.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:22.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:22.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:23.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:23.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:23.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:23.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:24.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:24.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:24.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:24.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:25.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:25.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:25.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:25.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:26.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:26.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:26.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:26.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:27.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:27.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:27.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:27.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:28.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:28.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:28.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:28.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:29.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:29.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:29.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:29.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:30.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:30.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:30.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:30.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:31.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:31.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:31.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:31.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:32.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:32.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:32.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:32.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:33.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:33.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:34.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:34.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:34.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:34.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:35.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:35.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:35.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:35.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:36.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:35.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:36.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:36.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:37.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:37.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:37.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:37.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:38.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:38.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:38.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:38.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:39.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:39.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:39.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:39.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:40.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:40.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:40.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:40.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:41.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:41.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:41.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:41.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:42.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:42.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:42.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:42.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:43.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:43.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:43.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:43.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:44.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:44.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:44.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:44.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:45.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:45.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:45.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:45.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:46.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:46.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:46.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:46.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:47.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:47.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:47.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:47.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:48.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:48.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:48.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:48.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:49.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:49.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:49.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:49.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:50.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:50.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:50.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:50.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:51.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:51.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:51.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:51.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:52.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:52.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:52.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:52.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:53.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:53.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:53.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:53.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:54.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:54.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:54.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:54.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:55.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:55.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:55.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:55.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:56.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:56.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:56.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:56.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:57.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:57.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:57.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:57.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:58.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:58.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:58.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:58.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:59.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:25:59.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:25:59.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:25:59.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:00.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:00.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:00.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:00.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:01.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:01.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:01.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:01.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:02.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:02.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:02.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:02.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:03.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:03.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:03.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:03.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:04.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:04.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:04.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:04.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:05.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:05.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:05.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:05.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:06.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:06.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:06.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:06.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:07.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:07.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:07.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:07.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:08.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:08.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:08.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:08.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:09.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:09.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:09.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:09.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:10.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:10.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:10.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:10.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:11.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:11.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:11.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:11.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:12.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:12.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:12.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:12.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:13.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:13.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:13.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:13.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:14.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:14.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:14.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:14.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:15.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:15.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:15.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:15.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:16.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:16.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:16.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:16.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:17.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:17.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:17.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:17.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:18.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:18.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:18.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:18.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:19.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:19.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:19.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:19.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:20.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:20.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:20.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:20.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:21.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:21.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:21.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:21.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:22.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:22.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:22.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:22.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:23.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:23.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:23.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:23.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:24.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:24.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:24.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:24.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:25.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:25.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:25.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:25.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:26.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:26.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:26.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:26.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:27.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:27.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:27.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:27.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:28.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:28.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:28.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:28.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:28.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:28.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:29.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:29.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:30.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:30.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:30.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:30.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:30.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:30.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:31.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:31.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:31.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:31.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:32.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:32.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:32.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:32.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:33.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:33.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:33.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:33.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:34.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:34.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:34.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:34.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:35.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:35.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:35.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:35.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:36.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:36.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:36.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:36.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:37.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:37.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:37.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:37.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:38.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:38.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:38.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:38.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:39.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:39.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:39.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:39.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:40.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:40.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:40.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:40.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:41.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:41.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:41.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:41.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:42.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:42.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:42.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:42.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:43.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:43.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:43.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:43.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:44.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:43.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:44.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:44.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:44.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:44.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:45.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:45.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:45.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:45.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:46.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:46.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:47.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:47.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:47.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:47.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:48.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:48.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:48.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:48.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:49.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:49.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:49.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:49.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:50.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:50.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:50.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:50.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:51.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:51.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:51.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:51.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:52.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:52.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:52.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:52.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:53.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:53.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:53.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:54.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:54.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:54.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:54.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:55.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:55.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:55.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:55.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:56.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:56.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:56.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:56.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:57.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:57.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:57.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:57.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:58.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:58.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:58.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:58.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:59.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:26:59.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:26:59.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:26:59.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:00.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:00.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:00.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:00.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:01.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:01.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:01.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:01.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:02.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:02.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:02.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:02.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:03.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:03.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:03.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:03.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:04.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:04.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:04.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:04.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:05.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:05.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:05.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:05.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:06.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:06.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:06.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:06.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:06.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:06.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:07.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:07.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:07.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:07.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:08.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:08.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:08.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:08.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:09.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:09.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:09.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:09.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:10.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:10.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:10.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:10.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:11.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:11.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:11.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:11.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:12.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:12.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:13.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:13.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:13.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:13.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:13.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:13.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:14.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:14.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:15.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:14.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:15.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:15.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:16.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:16.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:16.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:16.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:17.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:16.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:17.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:17.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:17.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:17.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:18.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:18.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:19.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:19.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:19.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:19.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:20.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:20.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:20.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:20.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:21.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:21.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:22.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:22.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:22.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:22.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:23.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:23.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:23.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:23.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:23.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:23.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:24.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:24.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:24.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:24.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:25.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:25.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:26.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:26.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:26.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:26.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:27.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:27.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:27.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:27.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:27.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:27.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:28.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:28.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:28.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:28.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:29.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:29.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:29.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:29.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:29.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:29.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:30.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:30.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:31.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:31.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:31.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:31.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:32.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:31.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:32.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:32.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:33.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:33.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:33.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:33.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:34.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:34.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:35.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:35.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:35.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:35.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:36.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:36.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:36.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:36.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:36.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:36.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:37.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:37.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:37.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:37.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:38.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:38.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:38.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:38.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:39.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:39.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:39.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:39.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:39.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:39.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:40.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:40.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:41.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:41.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:41.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:41.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:41.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:41.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:42.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:42.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:43.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:43.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:43.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:43.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:44.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:44.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:44.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:44.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:45.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:45.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:45.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:45.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:46.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:46.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:46.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:46.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:47.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:47.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:47.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:47.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:48.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:48.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:48.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:48.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:49.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:49.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:49.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:49.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:50.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:50.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:50.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:50.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:51.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:51.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:51.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:51.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:52.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:52.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:52.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:52.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:53.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:53.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:53.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:53.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:54.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:54.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:55.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:55.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:55.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:55.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:55.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:55.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:56.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:56.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:56.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:56.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:57.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:57.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:57.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:57.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:58.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:58.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:59.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:59.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:59.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:27:59.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:27:59.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:27:59.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:00.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:00.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:00.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:00.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:01.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:01.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:01.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:01.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:02.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:02.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:03.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:02.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:03.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:03.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:04.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:04.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:04.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:04.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:05.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:05.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:05.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:05.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:06.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:06.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:06.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:06.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:07.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:07.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:07.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:07.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:08.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:08.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:08.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:08.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:08.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:08.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:09.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:09.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:10.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:10.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:10.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:10.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:11.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:11.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:11.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:11.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:12.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:12.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:12.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:12.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:13.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:12.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:13.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:13.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:13.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:13.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:14.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:14.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:14.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:14.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:15.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:15.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:16.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:16.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:16.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:16.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:16.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:16.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:17.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:17.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:18.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:18.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:18.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:18.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:19.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:19.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:19.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:19.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:20.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:20.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:20.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:20.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:21.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:21.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:21.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:21.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:22.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:22.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:22.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:22.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:23.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:23.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:23.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:23.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:24.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:24.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:24.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:24.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:25.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:25.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:25.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:25.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:26.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:26.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:26.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:26.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:27.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:27.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:27.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:27.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:28.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:28.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:28.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:28.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:29.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:29.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:29.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:29.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:30.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:30.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:30.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:30.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:31.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:31.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:31.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:31.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:32.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:32.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:32.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:32.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:33.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:33.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:33.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:33.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:34.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:34.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:34.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:34.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:35.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:35.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:35.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:35.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:36.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:36.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:36.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:36.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:36.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:36.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:37.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:37.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:37.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:37.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:38.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:38.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:38.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:38.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:39.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:39.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:39.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:39.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:40.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:40.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:40.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:40.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:41.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:41.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:41.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:41.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:42.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:42.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:42.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:42.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:43.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:43.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:43.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:43.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:44.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:44.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:44.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:44.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:45.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:45.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:45.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:45.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:46.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:46.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:46.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:46.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:47.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:47.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:47.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:47.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:48.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:48.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:48.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:48.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:49.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:49.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:49.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:49.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:50.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:50.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:50.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:50.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:51.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:51.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:52.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:52.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:52.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:52.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:53.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:53.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:53.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:53.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:54.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:54.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:54.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:54.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:55.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:55.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:55.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:55.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:56.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:56.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:56.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:57.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:57.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:57.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:57.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:58.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:58.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:58.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:58.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:59.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:28:59.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:28:59.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:28:59.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:00.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:00.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:00.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:00.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:01.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:01.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:01.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:01.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:02.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:02.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:02.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:02.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:03.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:03.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:03.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:03.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:04.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:04.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:04.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:04.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:05.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:05.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:05.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:05.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:06.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:06.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:06.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:06.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:07.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:07.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:07.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:07.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:08.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:08.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:08.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:08.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:09.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:09.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:09.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:09.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:10.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:10.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:10.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:10.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:11.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:11.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:11.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:11.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:12.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:12.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:12.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:12.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:13.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:13.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:13.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:13.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:14.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:14.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:14.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:14.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:15.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:15.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:15.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:15.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:16.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:16.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:16.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:16.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:17.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:17.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:17.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:17.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:18.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:18.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:18.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:18.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:19.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:19.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:19.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:19.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:20.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:20.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:20.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:20.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:21.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:21.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:21.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:21.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:22.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:22.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:22.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:22.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:23.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:23.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:23.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:23.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:24.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:24.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:24.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:24.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:25.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:25.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:25.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:25.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:26.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:26.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:26.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:26.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:27.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:27.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:27.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:27.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:28.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:28.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:28.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:28.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:29.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:29.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:29.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:29.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:30.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:30.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:30.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:30.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:31.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:31.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:31.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:31.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:32.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:32.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:32.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:32.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:33.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:33.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:33.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:33.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:34.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:34.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:34.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:34.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:35.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:35.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:35.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:35.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:36.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:36.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:36.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:36.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:37.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:37.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:37.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:37.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:38.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:38.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:38.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:38.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:39.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:39.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:39.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:39.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:40.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:40.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:40.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:40.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:41.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:41.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:41.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:41.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:42.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:42.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:42.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:42.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:43.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:43.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:43.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:43.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:44.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:44.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:44.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:44.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:45.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:45.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:45.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:45.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:46.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:46.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:46.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:46.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:47.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:47.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:47.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:47.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:48.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:48.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:48.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:48.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:49.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:49.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:49.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:49.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:50.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:50.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:50.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:50.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:51.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:51.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:51.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:51.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:52.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:52.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:52.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:52.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:53.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:53.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:53.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:53.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:54.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:54.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:54.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:54.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:55.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:55.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:55.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:55.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:56.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:56.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:56.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:56.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:57.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:57.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:57.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:57.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:58.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:58.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:58.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:58.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:59.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:29:59.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:29:59.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:29:59.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:00.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:00.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:00.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:00.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:01.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:01.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:01.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:01.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:02.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:02.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:02.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:02.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:03.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:03.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:03.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:03.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:04.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:04.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:04.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:04.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:05.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:05.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:05.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:05.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:06.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:06.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:06.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:06.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:07.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:07.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:07.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:07.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:08.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:08.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:08.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:08.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:09.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:09.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:09.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:09.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:10.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:10.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:10.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:10.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:11.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:11.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:11.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:11.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:12.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:12.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:12.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:12.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:13.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:13.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:13.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:13.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:14.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:14.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:14.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:14.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:15.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:15.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:15.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:15.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:16.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:16.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:16.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:16.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:17.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:17.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:17.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:17.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:18.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:18.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:18.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:18.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:19.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:19.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:19.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:19.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:20.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:20.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:20.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:20.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:21.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:21.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:21.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:21.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:22.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:22.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:22.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:22.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:23.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:23.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:23.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:23.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:24.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:24.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:24.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:24.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:25.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:25.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:25.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:25.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:26.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:26.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:26.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:26.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:27.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:27.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:27.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:27.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:28.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:28.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:28.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:28.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:29.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:29.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:29.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:29.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:30.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:30.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:30.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:30.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:31.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:31.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:31.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:31.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:32.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:32.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:32.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:32.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:33.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:33.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:33.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:33.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:34.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:34.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:34.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:34.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:35.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:35.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:35.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:35.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:36.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:36.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:36.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:36.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:37.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:37.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:37.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:37.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:38.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:38.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:38.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:38.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:39.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:39.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:39.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:39.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:40.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:40.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:40.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:40.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:41.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:41.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:41.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:41.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:42.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:42.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:42.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:42.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:43.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:43.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:43.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:43.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:44.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:44.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:44.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:44.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:45.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:45.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:45.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:45.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:46.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:46.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:46.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:46.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:47.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:47.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:47.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:47.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:48.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:48.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:48.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:48.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:49.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:49.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:49.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:49.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:50.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:50.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:50.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:50.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:51.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:51.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:51.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:51.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:52.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:52.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:52.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:52.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:53.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:53.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:53.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:53.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:54.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:54.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:54.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:54.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:55.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:55.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:55.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:55.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:56.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:56.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:56.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:56.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:57.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:57.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:57.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:57.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:58.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:58.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:58.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:58.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:59.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:30:59.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:30:59.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:30:59.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:00.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:00.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:00.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:00.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:01.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:01.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:01.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:01.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:02.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:02.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:02.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:02.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:03.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:03.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:03.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:03.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:04.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:04.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:04.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:04.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:05.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:05.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:05.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:05.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:06.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:06.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:06.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:06.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:07.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:07.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:07.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:07.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:08.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:08.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:09.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:09.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:09.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:09.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:10.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:10.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:10.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:10.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:11.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:11.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:11.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:11.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:12.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:12.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:12.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:12.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:13.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:13.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:13.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:13.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:14.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:14.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:14.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:14.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:15.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:15.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:15.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:15.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:15.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:15.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:16.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:16.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:16.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:16.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:17.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:17.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:17.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:17.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:18.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:18.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:18.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:18.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:19.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:19.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:19.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:19.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:20.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:20.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:20.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:20.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:21.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:21.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:21.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:21.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:22.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:22.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:22.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:22.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:23.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:23.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:23.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:23.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:24.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:24.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:24.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:24.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:25.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:25.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:25.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:25.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:26.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:26.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:26.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:26.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:27.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:27.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:27.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:27.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:28.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:28.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:28.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:28.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:29.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:29.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:29.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:29.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:30.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:30.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:30.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:30.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:31.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:31.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:31.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:31.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:32.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:32.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:32.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:32.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:33.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:33.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:33.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:33.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:34.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:34.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:34.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:34.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:35.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:35.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:35.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:35.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:36.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:36.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:36.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:36.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:37.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:37.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:37.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:37.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:38.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:38.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:38.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:38.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:39.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:39.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:39.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:39.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:40.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:40.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:40.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:40.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:41.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:41.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:41.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:41.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:42.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:42.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:42.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:42.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:43.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:43.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:43.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:43.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:44.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:44.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:44.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:44.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:45.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:45.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:45.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:45.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:46.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:46.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:46.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:46.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:47.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:47.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:47.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:47.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:48.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:48.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:48.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:48.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:49.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:49.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:49.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:49.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:50.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:50.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:50.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:50.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:51.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:51.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:51.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:51.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:52.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:52.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:52.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:52.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:53.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:53.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:53.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:53.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:54.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:54.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:54.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:54.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:55.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:55.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:55.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:55.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:56.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:56.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:56.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:56.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:57.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:57.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:57.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:57.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:58.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:58.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:58.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:58.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:59.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:31:59.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:31:59.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:31:59.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:00.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:00.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:00.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:00.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:01.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:01.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:01.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:01.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:02.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:02.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:02.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:02.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:03.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:03.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:03.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:03.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:04.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:04.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:04.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:04.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:05.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:05.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:05.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:05.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:06.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:06.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:06.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:06.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:07.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:07.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:07.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:07.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:08.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:08.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:08.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:08.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:09.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:09.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:09.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:09.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:10.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:10.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:10.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:10.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:11.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:11.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:11.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:11.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:12.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:12.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:12.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:12.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:13.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:13.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:13.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:13.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:14.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:14.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:14.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:14.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:15.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:15.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:15.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:15.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:16.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:16.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:16.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:16.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:17.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:17.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:17.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:17.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:18.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:18.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:18.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:18.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:19.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:19.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:19.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:19.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:20.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:20.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:20.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:20.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:21.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:21.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:22.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:21.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:22.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:22.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:23.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:22.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:23.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:23.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:24.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:24.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:24.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:24.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:24.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:24.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:25.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:25.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:26.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:26.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:26.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:26.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:27.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:27.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:27.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:27.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:28.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:28.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:28.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:28.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:29.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:29.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:29.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:29.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:30.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:30.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:30.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:30.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:31.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:31.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:31.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:31.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:32.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:32.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:32.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:32.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:33.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:33.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:33.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:33.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:34.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:33.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:34.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:34.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:35.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:35.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:35.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:35.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:36.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:36.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:36.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:36.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:36.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:36.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:37.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:37.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:37.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:37.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:38.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:38.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:38.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:38.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:39.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:39.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:40.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:40.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:40.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:40.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:41.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:41.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:41.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:41.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:42.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:42.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:42.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:42.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:43.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:43.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:43.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:43.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:44.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:44.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:44.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:44.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:45.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:45.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:45.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:45.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:46.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:46.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:46.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:46.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:47.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:47.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:47.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:47.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:48.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:48.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:48.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:48.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:49.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:49.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:49.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:49.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:50.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:50.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:50.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:51.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:51.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:51.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:51.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:52.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:52.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:52.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:52.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:53.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:53.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:53.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:53.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:54.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:54.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:54.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:54.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:55.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:55.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:55.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:55.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:56.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:56.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:56.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:56.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:57.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:57.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:57.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:57.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:58.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:58.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:58.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:58.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:59.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:32:59.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:32:59.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:32:59.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:00.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:00.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:00.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:00.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:01.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:01.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:01.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:01.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:02.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:02.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:02.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:02.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:03.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:03.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:03.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:03.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:04.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:04.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:04.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:04.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:05.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:05.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:05.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:05.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:06.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:06.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:06.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:06.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:07.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:07.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:07.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:07.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:08.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:08.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:08.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:08.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:09.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:09.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:10.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:10.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:10.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:10.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:11.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:11.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:11.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:11.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:12.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:12.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:12.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:12.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:13.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:13.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:13.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:13.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:14.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:14.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:14.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:14.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:15.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:15.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:15.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:15.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:16.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:16.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:16.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:16.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:17.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:17.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:17.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:17.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:18.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:18.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:18.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:18.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:18.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:18.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:19.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:19.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:20.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:20.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:20.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:20.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:21.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:21.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:21.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:21.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:22.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:22.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:22.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:22.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:23.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:23.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:23.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:23.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:24.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:24.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:24.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:24.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:25.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:25.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:25.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:25.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:26.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:26.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:26.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:26.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:27.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:27.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:27.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:27.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:28.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:28.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:28.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:28.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:29.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:29.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:29.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:29.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:30.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:30.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:30.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:30.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:31.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:31.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:31.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:31.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:32.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:32.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:32.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:32.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:33.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:33.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:33.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:33.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:34.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:34.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:34.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:34.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:35.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:35.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:35.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:35.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:36.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:36.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:36.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:36.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:37.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:37.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:37.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:37.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:38.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:38.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:38.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:38.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:39.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:39.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:39.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:39.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:40.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:40.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:40.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:40.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:41.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:41.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:41.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:41.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:42.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:42.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:42.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:42.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:43.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:43.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:43.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:43.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:44.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:44.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:44.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:44.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:45.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:45.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:45.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:45.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:46.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:46.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:46.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:46.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:47.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:47.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:47.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:47.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:48.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:48.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:48.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:48.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:49.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:49.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:49.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:49.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:50.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:50.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:50.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:50.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:51.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:51.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:51.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:51.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:52.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:52.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:52.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:53.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:53.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:53.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:53.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:54.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:54.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:54.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:54.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:55.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:55.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:55.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:55.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:56.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:56.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:56.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:56.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:57.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:57.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:57.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:57.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:58.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:58.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:58.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:58.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:59.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:33:59.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:33:59.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:33:59.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:00.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:00.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:00.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:00.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:01.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:01.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:01.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:01.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:02.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:02.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:02.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:02.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:03.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:03.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:03.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:03.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:04.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:04.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:04.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:04.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:05.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:05.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:05.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:05.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:06.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:06.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:06.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:06.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:07.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:07.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:07.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:07.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:08.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:08.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:08.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:08.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:09.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:09.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:09.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:09.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:10.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:10.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:10.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:10.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:11.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:11.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:11.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:11.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:12.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:12.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:12.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:12.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:13.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:13.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:13.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:13.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:14.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:14.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:14.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:14.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:15.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:15.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:15.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:15.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:16.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:16.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:16.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:16.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:17.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:17.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:17.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:17.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:18.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:18.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:18.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:18.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:19.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:19.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:19.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:19.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:20.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:20.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:20.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:20.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:21.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:21.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:21.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:21.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:22.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:22.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:22.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:22.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:23.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:23.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:23.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:23.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:24.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:24.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:24.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:24.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:25.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:25.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:25.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:25.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:26.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:26.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:26.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:26.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:27.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:27.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:27.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:27.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:28.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:28.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:28.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:28.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:29.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:29.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:29.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:29.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:30.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:30.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:30.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:30.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:31.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:31.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:31.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:31.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:32.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:32.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:32.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:32.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:33.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:33.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:33.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:33.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:34.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:34.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:34.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:34.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:35.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:35.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:35.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:35.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:36.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:36.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:36.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:36.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:37.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:37.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:37.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:37.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:38.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:38.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:38.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:38.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:39.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:39.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:39.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:39.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:40.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:40.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:40.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:40.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:41.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:41.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:41.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:41.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:42.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:42.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:42.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:42.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:43.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:43.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:43.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:43.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:44.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:44.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:44.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:44.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:45.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:45.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:45.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:45.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:46.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:46.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:46.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:46.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:47.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:47.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:47.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:47.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:48.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:48.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:48.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:48.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:49.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:49.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:49.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:49.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:49.605 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T02:34:49.600+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d64d88e0 msgr2=0x7f5fa403f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T02:34:49.609 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T02:34:49.604+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d63e73c0 msgr2=0x7f5fa4066b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T02:34:49.614 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T02:34:49.608+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d64d88e0 msgr2=0x7f5fa403f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T02:34:50.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:50.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:50.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:50.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:51.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:51.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:51.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:51.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:52.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:52.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:52.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:52.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:53.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:53.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:53.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:53.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:54.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:54.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:54.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:54.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:55.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:55.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:55.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:55.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:56.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:56.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:56.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:56.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:57.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:57.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:57.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:57.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:58.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:58.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:58.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:58.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:59.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:34:59.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:34:59.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:34:59.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:00.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:00.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:00.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:00.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:01.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:01.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:01.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:01.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:02.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:02.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:02.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:02.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:03.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:03.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:03.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:03.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:04.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:04.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:04.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:04.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:05.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:05.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:05.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:05.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:06.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:06.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:06.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:06.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:07.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:07.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:07.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:07.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:08.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:08.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:08.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:08.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:09.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:09.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:09.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:09.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:10.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:10.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:10.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:10.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:11.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:11.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:11.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:11.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:12.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:12.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:12.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:12.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:13.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:13.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:13.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:13.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:14.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:14.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:14.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:14.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:15.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:15.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:15.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:15.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:16.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:16.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:16.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:16.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:17.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:17.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:17.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:17.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:18.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:18.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:18.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:18.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:19.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:19.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:19.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:19.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:20.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:20.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:20.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:20.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:21.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:21.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:21.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:21.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:22.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:22.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:22.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:22.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:23.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:23.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:23.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:23.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:24.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:24.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:24.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:24.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:25.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:25.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:25.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:25.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:26.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:26.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:26.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:26.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:27.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:27.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:27.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:27.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:28.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:28.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:28.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:28.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:29.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:29.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:29.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:29.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:30.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:30.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:30.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:30.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:31.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:31.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:31.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:31.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:32.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:32.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:32.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:32.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:33.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:33.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:33.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:33.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:34.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:34.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:34.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:34.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:35.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:35.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:35.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:35.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:36.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:36.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:36.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:36.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:37.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:37.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:37.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:37.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:38.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:38.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:38.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:38.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:39.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:39.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:39.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:39.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:40.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:40.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:40.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:40.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:41.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:41.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:41.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:41.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:42.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:42.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:42.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:42.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:43.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:43.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:43.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:43.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:44.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:44.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:44.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:44.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:45.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:45.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:45.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:45.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:46.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:46.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:46.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:46.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:47.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:47.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:47.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:47.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:48.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:48.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:48.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:48.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:49.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:49.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:49.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:49.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:50.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:50.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:50.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:50.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:51.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:51.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:51.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:51.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:52.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:52.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:52.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:52.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:53.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:53.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:53.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:53.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:54.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:54.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:54.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:54.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:55.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:55.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:55.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:55.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:56.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:56.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:56.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:56.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:57.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:57.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:57.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:57.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:58.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:58.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:58.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:58.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:59.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:35:59.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:35:59.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:35:59.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:00.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:00.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:00.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:00.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:01.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:01.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:01.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:01.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:02.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:02.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:02.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:02.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:03.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:03.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:03.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:03.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:04.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:04.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:04.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:04.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:05.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:05.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:05.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:05.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:06.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:06.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:06.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:06.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:07.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:07.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:08.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:08.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:08.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:08.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:09.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:09.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:09.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:09.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:10.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:10.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:10.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:10.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:11.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:11.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:11.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:11.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:12.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:12.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:12.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:12.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:13.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:13.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:13.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:13.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:14.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:14.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:14.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:14.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:15.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:15.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:15.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:15.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:16.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:16.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:16.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:16.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:17.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:17.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:17.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:17.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:18.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:18.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:18.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:18.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:19.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:19.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:19.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:19.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:20.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:20.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:20.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:20.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:21.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:21.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:21.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:21.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:22.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:22.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:22.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:22.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:23.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:23.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:23.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:23.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:24.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:24.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:24.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:24.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:25.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:25.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:25.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:25.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:26.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:26.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:26.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:26.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:27.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:27.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:27.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:27.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:28.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:28.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:28.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:28.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:29.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:29.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:29.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:29.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:30.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:30.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:30.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:30.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:31.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:31.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:31.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:31.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:32.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:32.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:32.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:32.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:33.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:33.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:33.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:33.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:34.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:34.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:34.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:34.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:35.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:35.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:35.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:35.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:36.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:36.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:36.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:36.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:37.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:37.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:37.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:37.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:38.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:38.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:38.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:38.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:39.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:39.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:39.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:39.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:40.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:40.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:40.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:40.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:41.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:41.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:41.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:41.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:42.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:42.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:42.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:42.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:43.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:43.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:43.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:43.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:44.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:44.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:44.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:44.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:45.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:45.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:45.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:45.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:46.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:46.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:46.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:46.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:47.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:47.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:47.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:47.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:48.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:48.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:48.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:48.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:49.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:49.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:49.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:49.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:50.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:50.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:50.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:50.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:51.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:51.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:51.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:51.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:52.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:52.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:52.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:52.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:53.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:53.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:53.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:53.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:54.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:54.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:54.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:54.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:55.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:55.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:55.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:55.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:56.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:56.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:56.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:56.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:57.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:57.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:57.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:57.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:58.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:58.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:58.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:58.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:59.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:36:59.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:36:59.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:36:59.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:00.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:00.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:00.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:00.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:01.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:01.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:01.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:01.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:02.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:02.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:02.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:02.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:03.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:03.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:03.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:03.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:04.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:04.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:04.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:04.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:05.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:05.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:05.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:05.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:06.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:06.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:06.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:06.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:07.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:07.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:07.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:07.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:08.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:08.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:08.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:08.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:09.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:09.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:09.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:09.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:10.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:10.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:10.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:10.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:11.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:11.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:11.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:11.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:12.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:12.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:12.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:12.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:13.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:13.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:13.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:13.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:14.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:14.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:14.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:14.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:15.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:15.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:15.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:15.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:16.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:16.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:16.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:16.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:17.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:17.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:17.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:17.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:18.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:18.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:18.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:18.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:19.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:19.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:19.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:19.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:20.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:20.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:20.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:20.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:21.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:21.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:21.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:21.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:22.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:22.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:22.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:22.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:23.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:23.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:23.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:23.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:24.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:24.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:24.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:24.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:25.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:25.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:25.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:25.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:26.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:26.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:26.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:26.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:27.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:27.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:27.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:27.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:28.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:28.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:28.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:28.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:29.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:29.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:29.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:29.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:30.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:30.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:30.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:30.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:31.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:31.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:31.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:31.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:32.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:32.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:32.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:32.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:33.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:33.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:33.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:33.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:34.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:34.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:34.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:34.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:35.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:35.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:35.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:35.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:36.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:36.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:36.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:36.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:37.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:37.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:37.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:37.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:38.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:38.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:38.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:38.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:39.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:39.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:39.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:39.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:40.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:40.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:40.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:40.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:41.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:41.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:41.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:41.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:42.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:42.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:42.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:42.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:43.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:43.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:43.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:43.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:44.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:44.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:44.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:44.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:45.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:45.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:45.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:45.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:46.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:46.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:46.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:46.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:47.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:47.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:47.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:47.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:48.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:48.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:48.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:48.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:49.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:49.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:49.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:49.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:50.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:50.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:50.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:50.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:51.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:51.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:51.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:51.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:52.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:52.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:52.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:52.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:53.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:53.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:53.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:53.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:54.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:54.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:54.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:54.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:55.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:55.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:55.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:55.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:56.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:56.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:56.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:56.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:57.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:57.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:57.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:57.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:58.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:58.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:58.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:58.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:59.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:37:59.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:37:59.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:37:59.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:00.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:00.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:00.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:00.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:01.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:01.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:02.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:02.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:02.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:02.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:02.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:02.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:03.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:03.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:03.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:03.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:04.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:04.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:04.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:04.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:05.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:05.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:05.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:05.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:06.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:06.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:06.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:06.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:07.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:07.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:07.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:07.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:08.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:08.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:08.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:08.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:09.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:09.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:09.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:09.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:10.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:10.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:10.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:10.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:11.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:11.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:12.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:11.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:12.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:12.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:13.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:12.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:13.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:13.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:14.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:14.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:14.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:14.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:14.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:14.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:15.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:15.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:16.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:16.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:16.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:16.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:17.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:17.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:17.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:17.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:18.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:18.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:18.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:18.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:19.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:19.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:19.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:19.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:20.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:20.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:20.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:20.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:21.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:21.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:21.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:21.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:22.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:22.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:22.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:22.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:23.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:23.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:23.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:23.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:24.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:24.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:24.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:24.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:25.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:25.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:25.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:25.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:26.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:26.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:26.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:26.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:27.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:27.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:27.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:27.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:28.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:28.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:28.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:28.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:29.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:29.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:29.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:29.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:30.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:29.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:30.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:30.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:30.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:30.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:31.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:31.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:32.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:32.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:32.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:32.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:33.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:33.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:33.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:33.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:34.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:34.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:34.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:34.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:35.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:35.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:35.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:35.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:36.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:36.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:36.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:36.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:37.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:37.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:37.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:37.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:38.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:38.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:38.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:38.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:39.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:39.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:39.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:39.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:40.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:40.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:40.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:40.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:41.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:41.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:41.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:41.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:42.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:42.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:42.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:42.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:43.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:43.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:43.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:43.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:44.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:44.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:44.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:44.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:45.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:45.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:45.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:45.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:46.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:46.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:46.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:46.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:47.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:47.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:47.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:47.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:48.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:48.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:48.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:49.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:49.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:49.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:49.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:50.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:50.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:50.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:50.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:51.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:51.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:51.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:51.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:52.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:52.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:52.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:52.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:53.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:53.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:53.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:53.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:54.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:54.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:54.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:54.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:55.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:55.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:55.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:55.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:56.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:56.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:56.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:56.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:57.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:57.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:57.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:57.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:58.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:58.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:58.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:58.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:59.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:38:59.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:38:59.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:38:59.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:00.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:00.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:00.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:00.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:01.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:01.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:01.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:01.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:02.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:02.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:02.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:02.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:03.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:03.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:03.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:03.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:04.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:04.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:04.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:04.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:05.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:05.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:05.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:05.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:06.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:06.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:06.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:06.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:07.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:07.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:07.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:07.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:08.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:08.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:08.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:08.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:09.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:09.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:09.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:09.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:10.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:10.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:10.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:10.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:11.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:11.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:11.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:11.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:12.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:12.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:12.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:12.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:13.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:13.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:13.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:13.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:14.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:14.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:14.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:14.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:15.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:15.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:15.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:15.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:16.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:16.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:16.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:16.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:17.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:17.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:17.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:17.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:18.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:18.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:18.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:18.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:19.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:19.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:19.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:19.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:20.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:20.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:20.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:20.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:21.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:21.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:21.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:21.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:22.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:22.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:22.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:22.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:23.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:23.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:23.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:23.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:24.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:24.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:24.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:24.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:25.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:25.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:25.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:25.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:26.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:26.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:26.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:26.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:27.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:27.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:27.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:27.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:28.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:28.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:28.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:28.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:29.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:29.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:29.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:29.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:30.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:30.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:30.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:30.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:31.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:31.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:31.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:31.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:32.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:32.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:32.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:32.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:33.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:33.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:33.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:33.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:34.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:34.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:34.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:34.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:35.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:35.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:35.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:35.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:36.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:36.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:36.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:36.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:37.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:37.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:37.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:37.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:38.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:38.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:38.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:38.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:39.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:39.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:39.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:39.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:40.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:40.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:40.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:40.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:41.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:41.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:41.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:41.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:42.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:42.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:42.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:42.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:43.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:43.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:43.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:43.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:44.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:44.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:44.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:44.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:45.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:45.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:45.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:45.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:46.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:46.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:46.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:46.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:47.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:47.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:47.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:47.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:48.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:48.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:48.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:48.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:49.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:49.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:49.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:49.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:50.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:50.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:50.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:50.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:51.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:51.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:51.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:51.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:52.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:52.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:52.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:52.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:53.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:53.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:53.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:53.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:54.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:54.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:54.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:54.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:55.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:55.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:55.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:55.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:56.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:56.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:56.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:56.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:57.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:57.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:57.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:57.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:58.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:58.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:58.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:58.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:59.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:39:59.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:39:59.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:39:59.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:00.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:00.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:00.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:00.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:01.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:01.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:01.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:01.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:02.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:02.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:02.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:02.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:03.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:03.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:03.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:03.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:04.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:04.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:04.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:04.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:05.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:05.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:05.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:05.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:06.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:06.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:06.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:06.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:07.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:07.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:07.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:07.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:08.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:08.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:08.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:08.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:09.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:09.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:09.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:09.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:10.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:10.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:10.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:10.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:11.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:11.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:11.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:11.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:12.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:12.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:12.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:12.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:13.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:13.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:13.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:13.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:14.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:14.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:14.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:14.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:15.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:15.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:15.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:15.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:16.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:16.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:16.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:16.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:17.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:17.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:17.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:17.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:18.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:18.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:18.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:18.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:19.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:19.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:19.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:19.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:20.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:20.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:20.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:20.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:21.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:21.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:21.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:21.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:22.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:22.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:22.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:22.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:23.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:23.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:23.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:23.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:24.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:24.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:24.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:24.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:25.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:25.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:25.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:25.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:26.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:26.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:26.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:26.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:27.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:27.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:27.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:27.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:28.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:28.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:28.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:28.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:29.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:29.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:29.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:29.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:30.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:30.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:30.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:30.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:31.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:31.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:31.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:31.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:32.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:32.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:32.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:32.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:33.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:33.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:33.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:33.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:34.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:34.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:34.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:34.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:35.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:35.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:35.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:35.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:36.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:36.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:36.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:36.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:37.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:37.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:37.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:37.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:38.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:38.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:38.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:38.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:39.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:39.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:40.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:40.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:40.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:40.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:41.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:41.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:41.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:41.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:42.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:42.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:42.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:42.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:43.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:43.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:43.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:43.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:44.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:43.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:44.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:44.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:44.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:44.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:45.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:45.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:45.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:45.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:46.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:46.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:47.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:46.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:47.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:47.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:48.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:48.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:48.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:48.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:48.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:48.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:49.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:49.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:50.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:50.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:50.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:50.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:51.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:50.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:51.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:51.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:52.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:52.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:52.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:52.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:53.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:52.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:53.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:53.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:53.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:53.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:54.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:54.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:54.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:54.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:55.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:55.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:56.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:56.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:56.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:56.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:57.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:57.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:57.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:57.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:58.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:58.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:58.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:58.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:59.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:40:59.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:40:59.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:40:59.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:00.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:00.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:00.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:00.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:01.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:01.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:01.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:01.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:01.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:01.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:02.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:02.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:02.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:02.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:03.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:03.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:03.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:03.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:04.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:04.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:04.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:04.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:05.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:05.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:05.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:05.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:06.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:06.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:07.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:07.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:07.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:07.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:08.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:08.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:08.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:08.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:09.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:09.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:09.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:09.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:10.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:10.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:10.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:10.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:11.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:11.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:11.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:11.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:12.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:12.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:12.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:12.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:13.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:13.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:13.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:13.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:14.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:14.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:14.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:14.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:15.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:15.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:15.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:15.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:16.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:16.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:16.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:16.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:17.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:17.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:17.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:17.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:18.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:18.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:18.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:18.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:19.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:19.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:19.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:19.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:20.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:20.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:20.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:20.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:21.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:21.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:21.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:21.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:22.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:22.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:22.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:22.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:23.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:23.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:23.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:23.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:24.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:24.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:24.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:24.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:25.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:25.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:25.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:25.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:26.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:26.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:26.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:26.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:27.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:27.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:27.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:27.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:28.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:28.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:28.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:28.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:29.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:29.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:29.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:29.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:30.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:30.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:30.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:30.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:31.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:31.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:31.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:31.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:32.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:32.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:32.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:32.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:33.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:33.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:33.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:33.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:34.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:34.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:34.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:34.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:35.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:35.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:35.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:35.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:36.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:36.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:36.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:36.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:37.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:37.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:37.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:37.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:38.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:38.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:38.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:38.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:39.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:39.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:39.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:39.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:40.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:40.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:40.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:40.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:41.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:41.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:41.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:41.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:42.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:42.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:42.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:42.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:43.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:43.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:43.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:43.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:44.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:44.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:44.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:44.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:45.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:45.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:45.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:45.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:46.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:46.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:46.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:46.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:47.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:47.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:47.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:47.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:48.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:48.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:48.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:48.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:49.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:49.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:49.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:49.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:50.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:50.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:50.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:50.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:51.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:51.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:51.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:51.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:52.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:52.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:52.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:52.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:53.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:53.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:53.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:53.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:54.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:54.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:54.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:54.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:55.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:55.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:55.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:55.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:56.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:56.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:56.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:56.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:57.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:57.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:57.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:57.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:58.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:58.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:58.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:58.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:59.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:41:59.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:41:59.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:41:59.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:00.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:00.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:00.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:00.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:01.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:01.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:01.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:01.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:02.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:02.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:02.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:02.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:03.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:03.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:03.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:03.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:04.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:04.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:04.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:04.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:05.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:05.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:05.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:05.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:06.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:06.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:06.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:06.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:07.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:07.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:07.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:07.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:08.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:08.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:08.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:08.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:09.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:09.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:09.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:09.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:10.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:10.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:10.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:10.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:11.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:11.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:11.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:11.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:12.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:12.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:12.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:12.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:13.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:13.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:13.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:13.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:14.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:14.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:14.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:14.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:15.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:15.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:15.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:15.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:16.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:16.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:16.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:16.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:17.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:17.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:17.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:17.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:18.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:18.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:18.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:18.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:19.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:19.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:19.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:19.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:20.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:20.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:20.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:20.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:21.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:21.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:21.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:21.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:22.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:22.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:22.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:22.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:23.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:23.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:23.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:23.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:24.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:24.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:24.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:24.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:25.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:25.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:25.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:25.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:26.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:26.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:26.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:26.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:27.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:27.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:27.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:27.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:28.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:28.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:28.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:28.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:29.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:29.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:29.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:29.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:30.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:30.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:30.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:30.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:31.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:31.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:31.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:31.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:32.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:32.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:32.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:32.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:33.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:33.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:33.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:33.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:34.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:34.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:34.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:34.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:35.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:35.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:35.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:35.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:36.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:36.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:36.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:36.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:37.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:37.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:37.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:37.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:38.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:38.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:38.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:39.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:39.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:39.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:39.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:40.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:40.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:40.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:40.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:41.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:41.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:41.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:41.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:42.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:42.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:42.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:42.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:43.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:43.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:43.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:43.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:44.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:44.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:44.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:44.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:45.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:45.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:45.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:45.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:46.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:46.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:46.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:46.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:47.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:47.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:47.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:47.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:48.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:48.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:48.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:48.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:49.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:49.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:49.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:49.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:50.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:50.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:50.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:50.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:51.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:51.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:51.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:51.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:52.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:52.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:52.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:52.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:53.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:53.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:53.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:53.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:54.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:54.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:54.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:54.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:55.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:55.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:55.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:55.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:56.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:56.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:56.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:56.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:57.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:57.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:57.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:57.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:58.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:58.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:58.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:58.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:59.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:42:59.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:42:59.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:42:59.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:00.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:00.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:00.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:00.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:01.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:01.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:01.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:01.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:02.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:02.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:02.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:02.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:03.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:03.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:03.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:03.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:04.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:04.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:04.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:04.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:05.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:05.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:05.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:05.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:06.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:06.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:06.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:06.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:07.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:07.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:07.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:07.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:08.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:08.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:08.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:08.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:09.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:09.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:09.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:09.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:10.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:10.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:10.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:10.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:11.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:11.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:11.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:11.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:12.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:12.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:12.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:12.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:13.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:13.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:13.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:13.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:14.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:14.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:14.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:14.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:15.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:15.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:15.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:15.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:16.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:16.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:16.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:16.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:17.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:17.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:17.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:17.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:18.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:18.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:18.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:18.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:19.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:19.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:19.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:19.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:20.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:20.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:20.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:20.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:21.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:21.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:21.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:21.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:22.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:22.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:22.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:22.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:23.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:23.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:23.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:23.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:24.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:24.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:24.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:24.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:25.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:25.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:25.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:25.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:26.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:26.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:26.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:26.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:27.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:27.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:27.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:27.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:28.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:28.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:28.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:28.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:29.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:29.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:29.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:29.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:30.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:30.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:30.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:30.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:31.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:31.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:31.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:31.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:32.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:32.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:32.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:32.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:33.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:33.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:33.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:33.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:34.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:34.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:34.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:34.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:35.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:35.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:35.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:35.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:36.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:36.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:36.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:36.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:37.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:37.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:37.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:37.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:38.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:38.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:38.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:38.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:39.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:39.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:39.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:40.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:40.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:40.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:40.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:41.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:41.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:41.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:41.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:42.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:42.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:42.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:42.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:43.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:43.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:43.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:43.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:44.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:44.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:44.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:44.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:45.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:45.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:45.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:45.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:46.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:46.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:46.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:46.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:47.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:47.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:47.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:47.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:48.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:48.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:48.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:48.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:49.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:49.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:49.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:49.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:50.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:50.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:50.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:50.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:51.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:51.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:51.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:51.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:52.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:52.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:52.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:52.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:53.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:53.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:53.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:53.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:54.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:54.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:54.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:54.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:55.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:55.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:55.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:55.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:56.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:56.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:56.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:56.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:57.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:57.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:57.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:57.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:58.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:58.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:58.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:58.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:59.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:43:59.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:43:59.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:43:59.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:00.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:00.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:00.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:00.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:01.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:01.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:01.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:01.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:02.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:02.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:02.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:02.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:03.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:03.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:03.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:03.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:04.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:04.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:04.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:04.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:05.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:05.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:05.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:05.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:06.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:06.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:06.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:06.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:07.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:07.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:07.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:07.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:08.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:08.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:08.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:08.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:09.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:09.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:09.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:09.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:10.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:10.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:10.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:10.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:11.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:11.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:11.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:11.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:12.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:12.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:12.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:12.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:13.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:13.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:13.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:13.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:14.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:14.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:14.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:14.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:15.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:15.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:15.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:15.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:16.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:16.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:17.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:17.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:17.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:17.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:18.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:18.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:18.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:18.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:19.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:19.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:19.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:19.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:20.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:20.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:20.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:20.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:21.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:21.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:21.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:21.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:22.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:22.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:22.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:22.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:23.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:23.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:23.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:23.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:24.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:24.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:24.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:24.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:24.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:24.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:25.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:25.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:25.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:25.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:26.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:26.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:26.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:26.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:27.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:27.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:27.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:27.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:28.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:28.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:28.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:28.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:29.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:29.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:29.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:29.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:30.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:30.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:30.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:30.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:31.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:31.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:31.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:31.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:32.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:32.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:32.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:32.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:33.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:33.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:33.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:33.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:34.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:34.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:34.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:34.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:35.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:35.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:35.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:35.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:36.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:36.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:36.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:36.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:37.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:37.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:37.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:37.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:38.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:38.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:38.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:38.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:39.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:39.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:39.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:39.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:40.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:40.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:40.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:40.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:41.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:41.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:41.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:41.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:42.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:42.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:42.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:42.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:43.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:43.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:43.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:43.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:44.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:44.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:44.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:44.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:45.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:45.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:45.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:45.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:46.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:46.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:46.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:46.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:47.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:47.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:47.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:47.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:48.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:48.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:48.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:48.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:49.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:49.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:49.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:49.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:50.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:50.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:50.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:50.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:51.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:51.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:51.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:51.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:52.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:52.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:52.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:52.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:53.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:53.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:53.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:53.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:54.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:54.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:54.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:54.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:55.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:55.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:55.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:55.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:56.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:56.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:56.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:56.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:57.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:57.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:57.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:57.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:58.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:58.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:58.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:58.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:59.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:44:59.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:44:59.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:44:59.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:00.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:00.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:00.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:00.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:01.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:01.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:01.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:01.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:02.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:02.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:02.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:02.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:03.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:03.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:03.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:03.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:04.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:04.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:04.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:04.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:05.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:05.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:05.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:05.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:06.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:06.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:06.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:06.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:07.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:07.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:07.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:07.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:08.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:08.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:09.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:09.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:09.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:09.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:10.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:10.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:10.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:10.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:10.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:10.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:11.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:11.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:11.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:11.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:12.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:12.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:12.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:12.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:13.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:13.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:13.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:13.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:14.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:14.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:14.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:14.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:15.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:15.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:15.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:15.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:16.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:16.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:16.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:16.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:17.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:17.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:17.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:17.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:18.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:18.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:18.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:18.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:19.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:19.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:19.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:19.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:20.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:20.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:20.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:20.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:21.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:21.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:21.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:21.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:22.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:22.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:22.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:22.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:23.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:23.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:23.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:23.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:24.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:24.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:24.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:24.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:25.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:25.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:25.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:25.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:26.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:26.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:26.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:26.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:27.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:27.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:27.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:27.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:28.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:28.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:28.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:28.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:29.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:29.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:29.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:29.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:30.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:30.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:30.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:30.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:31.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:31.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:31.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:31.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:32.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:32.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:32.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:32.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:33.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:33.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:33.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:33.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:34.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:34.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:34.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:34.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:35.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:35.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:35.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:35.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:36.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:36.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:36.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:36.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:37.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:37.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:37.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:37.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:38.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:38.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:38.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:38.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:39.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:39.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:39.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:39.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:40.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:40.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:40.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:40.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:41.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:41.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:41.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:41.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:42.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:42.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:42.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:42.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:43.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:43.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:43.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:43.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:44.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:44.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:44.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:44.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:45.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:45.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:45.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:45.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:46.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:46.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:46.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:46.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:47.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:47.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:47.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:47.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:48.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:48.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:48.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:48.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:49.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:49.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:49.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:49.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:50.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:50.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:50.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:50.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:51.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:51.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:51.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:51.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:52.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:52.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:52.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:52.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:53.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:53.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:53.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:53.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:54.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:54.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:54.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:54.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:55.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:55.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:55.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:55.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:56.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:56.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:56.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:56.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:57.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:57.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:57.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:57.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:58.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:58.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:58.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:58.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:59.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:45:59.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:45:59.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:45:59.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:00.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:00.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:00.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:00.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:01.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:01.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:01.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:01.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:02.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:02.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:02.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:02.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:03.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:03.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:04.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:04.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:04.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:04.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:04.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:04.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:05.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:05.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:05.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:05.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:06.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:06.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:06.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:06.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:07.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:07.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:08.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:08.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:08.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:08.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:09.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:09.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:09.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:09.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:10.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:10.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:10.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:10.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:11.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:11.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:11.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:11.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:12.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:12.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:12.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:12.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:13.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:13.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:13.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:13.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:14.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:14.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:14.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:14.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:15.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:15.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:15.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:15.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:16.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:16.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:16.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:16.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:17.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:17.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:17.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:17.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:18.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:18.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:18.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:18.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:19.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:19.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:19.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:19.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:20.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:20.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:20.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:20.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:21.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:21.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:21.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:21.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:22.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:22.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:22.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:22.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:23.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:23.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:23.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:23.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:24.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:24.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:24.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:24.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:25.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:25.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:25.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:25.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:26.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:26.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:26.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:26.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:27.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:27.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:27.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:27.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:28.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:28.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:28.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:28.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:29.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:29.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:29.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:30.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:30.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:30.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:30.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:31.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:31.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:31.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:31.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:32.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:32.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:32.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:32.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:33.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:33.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:33.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:33.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:34.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:34.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:34.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:34.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:35.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:35.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:35.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:35.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:36.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:36.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:36.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:36.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:37.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:37.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:37.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:37.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:38.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:38.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:38.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:38.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:39.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:39.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:39.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:39.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:40.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:40.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:40.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:40.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:41.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:41.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:41.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:41.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:42.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:42.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:42.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:42.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:43.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:43.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:43.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:43.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:44.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:44.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:44.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:44.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:45.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:45.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:45.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:45.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:46.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:46.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:46.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:46.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:47.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:47.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:47.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:47.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:48.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:48.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:48.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:48.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:49.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:49.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:49.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:49.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:50.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:50.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:50.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:50.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:51.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:51.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:51.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:51.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:52.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:52.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:52.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:52.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:53.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:53.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:53.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:53.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:54.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:54.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:54.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:54.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:55.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:55.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:55.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:55.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:56.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:56.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:56.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:56.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:57.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:57.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:57.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:57.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:58.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:58.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:58.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:58.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:59.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:46:59.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:46:59.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:46:59.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:00.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:00.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:00.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:00.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:01.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:01.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:01.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:01.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:02.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:02.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:02.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:02.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:03.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:03.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:03.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:03.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:04.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:04.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:04.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:04.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:05.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:05.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:05.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:05.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:06.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:06.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:06.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:06.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:07.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:07.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:07.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:07.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:08.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:08.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:08.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:08.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:09.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:09.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:09.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:09.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:10.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:10.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:10.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:10.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:11.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:11.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:11.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:11.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:12.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:12.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:12.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:12.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:13.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:13.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:13.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:13.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:14.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:14.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:14.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:14.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:15.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:15.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:15.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:15.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:16.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:16.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:16.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:16.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:17.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:17.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:17.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:17.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:18.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:18.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:18.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:18.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:19.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:19.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:19.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:19.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:20.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:20.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:20.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:20.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:21.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:21.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:21.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:21.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:22.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:22.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:22.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:22.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:23.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:23.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:23.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:23.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:24.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:24.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:24.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:24.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:25.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:25.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:25.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:25.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:26.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:26.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:26.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:26.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:27.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:27.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:28.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:28.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:28.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:28.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:29.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:29.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:29.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:29.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:30.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:30.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:30.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:30.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:31.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:31.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:31.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:31.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:32.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:32.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:32.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:32.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:33.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:33.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:33.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:33.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:34.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:34.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:34.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:34.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:35.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:35.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:35.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:35.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:35.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:35.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:36.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:36.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:36.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:36.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:37.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:37.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:38.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:38.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:38.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:38.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:38.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:38.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:39.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:39.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:39.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:39.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:40.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:40.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:40.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:40.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:41.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:41.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:41.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:41.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:42.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:42.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:42.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:42.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:43.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:43.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:43.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:43.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:44.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:44.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:44.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:44.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:45.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:45.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:46.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:46.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:46.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:46.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:47.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:47.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:47.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:47.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:48.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:48.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:48.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:48.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:49.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:49.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:49.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:49.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:50.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:50.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:50.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:50.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:51.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:51.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:51.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:51.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:52.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:52.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:52.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:52.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:53.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:53.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:53.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:53.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:54.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:54.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:54.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:54.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:55.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:55.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:55.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:55.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:56.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:56.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:56.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:56.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:57.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:57.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:57.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:57.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:58.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:58.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:58.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:58.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:59.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:47:59.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:47:59.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:47:59.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:00.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:00.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:00.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:00.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:01.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:01.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:01.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:01.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:02.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:02.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:02.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:02.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:03.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:03.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:03.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:03.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:04.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:04.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:04.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:04.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:05.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:05.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:05.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:05.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:06.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:06.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:06.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:06.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:07.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:07.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:07.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:07.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:08.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:08.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:08.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:08.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:09.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:09.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:09.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:09.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:10.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:10.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:10.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:10.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:11.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:11.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:11.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:11.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:12.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:12.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:12.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:12.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:13.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:13.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:13.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:13.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:14.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:14.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:14.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:14.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:15.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:15.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:15.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:15.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:16.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:16.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:16.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:16.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:17.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:17.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:17.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:17.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:18.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:18.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:18.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:18.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:19.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:19.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:19.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:19.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:20.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:20.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:20.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:20.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:21.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:21.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:21.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:21.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:22.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:22.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:22.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:22.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:23.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:23.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:23.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:23.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:24.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:24.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:24.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:24.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:25.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:25.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:25.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:25.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:26.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:26.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:26.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:26.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:27.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:27.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:27.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:27.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:28.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:28.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:28.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:28.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:29.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:29.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:29.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:29.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:30.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:30.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:30.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:30.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:31.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:31.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:31.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:31.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:32.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:32.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:32.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:32.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:33.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:33.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:33.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:33.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:34.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:34.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:34.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:34.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:35.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:35.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:35.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:35.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:36.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:36.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:36.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:36.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:37.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:37.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:37.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:37.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:38.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:38.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:38.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:38.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:39.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:39.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:39.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:39.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:40.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:40.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:40.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:40.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:41.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:41.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:41.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:41.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:42.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:42.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:42.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:42.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:43.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:43.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:43.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:43.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:44.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:44.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:44.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:44.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:45.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:45.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:45.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:45.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:46.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:46.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:46.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:46.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:47.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:47.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:47.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:47.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:48.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:48.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:48.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:48.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:49.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:49.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:49.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:49.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:50.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:50.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:50.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:50.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:51.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:51.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:51.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:51.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:52.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:52.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:52.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:52.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:53.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:53.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:53.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:53.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:54.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:54.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:54.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:54.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:55.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:55.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:55.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:55.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:56.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:56.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:56.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:56.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:57.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:57.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:57.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:57.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:58.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:58.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:58.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:58.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:59.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:48:59.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:48:59.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:48:59.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:00.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:00.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:00.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:00.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:01.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:01.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:01.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:01.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:02.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:02.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:02.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:02.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:03.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:03.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:03.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:03.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:04.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:04.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:04.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:04.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:05.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:05.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:05.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:05.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:06.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:06.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:06.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:06.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:07.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:07.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:07.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:07.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:08.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:08.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:08.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:08.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:09.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:09.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:09.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:09.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:10.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:10.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:10.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:10.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:11.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:11.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:11.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:11.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:12.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:12.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:12.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:12.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:13.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:13.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:13.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:13.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:14.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:14.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:14.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:14.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:15.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:15.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:15.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:15.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:16.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:16.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:16.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:16.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:17.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:17.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:17.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:17.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:18.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:18.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:18.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:18.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:19.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:19.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:19.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:19.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:20.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:20.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:20.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:20.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:21.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:21.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:21.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:21.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:22.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:22.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:22.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:22.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:23.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:23.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:23.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:23.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:24.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:24.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:24.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:24.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:25.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:25.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:25.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:25.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:26.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:26.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:26.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:26.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:27.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:27.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:27.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:27.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:28.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:28.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:28.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:28.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:29.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:29.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:29.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:29.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:30.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:30.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:30.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:30.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:31.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:31.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:31.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:31.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:32.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:32.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:32.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:32.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:33.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:33.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:33.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:33.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:34.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:34.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:34.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:34.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:35.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:35.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:35.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:35.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:36.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:36.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:36.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:36.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:37.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:37.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:37.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:37.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:38.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:38.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:38.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:38.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:39.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:39.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:39.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:39.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:40.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:40.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:40.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:40.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:41.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:41.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:41.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:41.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:42.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:42.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:42.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:42.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:43.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:43.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:43.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:43.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:44.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:44.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:44.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:44.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:45.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:45.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:45.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:45.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:46.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:46.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:46.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:46.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:47.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:47.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:47.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:47.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:48.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:48.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:48.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:48.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:49.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:49.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:49.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:49.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:50.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:50.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:50.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:50.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:51.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:51.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:51.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:51.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:52.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:52.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:52.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:52.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:53.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:53.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:53.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:53.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:54.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:54.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:54.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:54.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:55.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:55.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:55.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:55.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:56.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:56.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:56.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:56.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:57.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:57.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:58.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:57.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:58.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:58.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:59.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:49:59.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:49:59.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:49:59.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:00.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:00.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:00.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:00.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:01.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:01.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:01.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:01.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:02.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:02.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:02.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:02.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:03.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:03.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:03.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:03.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:03.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:03.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:04.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:04.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:04.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:04.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:05.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:05.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:05.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:05.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:06.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:06.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:06.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:06.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:07.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:07.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:07.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:07.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:08.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:08.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:08.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:08.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:09.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:09.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:09.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:09.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:10.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:10.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:10.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:10.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:11.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:11.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:11.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:11.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:12.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:12.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:12.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:12.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:13.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:13.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:13.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:13.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:14.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:14.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:14.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:14.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:15.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:15.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:15.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:15.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:16.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:16.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:16.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:16.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:17.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:17.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:17.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:18.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:18.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:18.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:18.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:19.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:19.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:19.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:19.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:20.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:20.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:20.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:20.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:21.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:21.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:21.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:21.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:22.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:22.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:22.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:22.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:23.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:23.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:23.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:23.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:24.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:24.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:24.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:24.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:25.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:25.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:25.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:25.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:26.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:26.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:26.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:26.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:27.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:27.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:27.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:27.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:28.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:28.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:28.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:28.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:29.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:29.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:29.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:29.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:30.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:30.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:30.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:30.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:31.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:31.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:31.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:31.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:32.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:32.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:32.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:32.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:33.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:33.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:33.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:33.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:34.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:34.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:34.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:34.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:35.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:35.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:35.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:35.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:36.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:36.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:36.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:36.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:37.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:37.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:37.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:37.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:38.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:38.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:38.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:38.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:39.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:39.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:39.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:39.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:40.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:40.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:40.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:40.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:41.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:41.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:41.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:41.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:42.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:42.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:42.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:42.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:43.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:43.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:43.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:43.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:44.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:44.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:44.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:44.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:45.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:45.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:45.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:45.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:46.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:46.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:46.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:46.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:47.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:47.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:47.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:47.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:48.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:48.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:48.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:48.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:49.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:49.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:49.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:49.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:50.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:50.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:50.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:50.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:51.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:51.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:51.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:51.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:52.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:52.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:52.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:52.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:53.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:53.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:53.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:53.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:54.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:54.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:54.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:54.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:55.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:55.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:55.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:55.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:56.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:56.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:56.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:56.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:57.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:57.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:57.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:57.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:58.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:58.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:58.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:58.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:59.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:50:59.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:50:59.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:50:59.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:00.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:00.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:00.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:00.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:01.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:01.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:01.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:01.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:02.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:02.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:02.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:02.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:03.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:03.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:03.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:03.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:04.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:04.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:04.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:04.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:05.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:05.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:05.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:05.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:06.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:06.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:06.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:06.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:07.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:07.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:07.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:07.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:08.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:08.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:08.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:08.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:09.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:09.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:09.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:09.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:10.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:10.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:10.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:10.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:11.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:11.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:11.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:11.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:12.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:12.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:12.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:12.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:13.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:13.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:13.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:13.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:14.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:14.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:14.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:14.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:15.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:15.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:15.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:15.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:16.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:16.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:16.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:16.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:17.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:17.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:17.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:17.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:18.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:18.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:18.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:18.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:19.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:19.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:19.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:19.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:20.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:20.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:20.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:20.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:21.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:21.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:21.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:21.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:22.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:22.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:22.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:22.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:23.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:23.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:23.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:23.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:24.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:24.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:24.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:24.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:25.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:25.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:25.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:25.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:26.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:26.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:26.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:26.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:27.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:27.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:27.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:27.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:28.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:28.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:28.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:28.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:29.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:29.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:29.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:29.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:30.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:30.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:30.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:30.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:31.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:31.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:31.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:31.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:32.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:32.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:32.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:32.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:33.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:33.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:33.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:33.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:34.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:34.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:34.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:34.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:35.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:35.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:35.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:35.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:36.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:36.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:36.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:36.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:37.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:37.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:37.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:37.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:38.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:38.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:38.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:38.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:39.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:39.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:39.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:39.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:40.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:40.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:40.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:40.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:41.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:41.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:41.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:41.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:42.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:42.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:42.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:42.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:43.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:43.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:43.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:43.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:44.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:44.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:44.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:44.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:45.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:45.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:45.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:45.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:46.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:46.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:46.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:46.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:47.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:47.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:47.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:47.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:48.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:48.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:48.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:48.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:49.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:49.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:49.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:49.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:50.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:50.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:50.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:50.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:51.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:51.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:51.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:51.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:52.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:52.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:52.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:52.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:53.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:53.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:53.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:53.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:54.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:54.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:54.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:54.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:55.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:55.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:55.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:55.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:56.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:56.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:57.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:57.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:57.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:57.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:58.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:57.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:58.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:58.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:59.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:59.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:51:59.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:51:59.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:00.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:51:59.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:00.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:00.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:01.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:01.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:01.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:01.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:02.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:02.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:02.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:02.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:03.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:03.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:03.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:03.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:04.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:04.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:04.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:04.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:05.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:05.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:05.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:05.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:06.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:06.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:06.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:06.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:07.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:07.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:07.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:07.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:08.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:07.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:08.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:08.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:09.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:09.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:09.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:09.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:09.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:09.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:10.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:10.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:11.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:11.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:11.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:11.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:12.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:12.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:12.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:12.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:12.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:12.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:13.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:13.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:14.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:14.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:14.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:14.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:15.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:15.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:15.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:15.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:16.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:16.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:16.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:16.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:17.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:17.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:17.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:17.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:17.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:17.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:18.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:18.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:18.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:18.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:19.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:19.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:20.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:20.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:20.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:20.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:21.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:21.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:21.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:21.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:22.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:22.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:22.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:22.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:23.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:22.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:23.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:23.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:24.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:24.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:24.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:24.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:25.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:25.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:25.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:25.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:25.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:25.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:26.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:26.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:26.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:26.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:27.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:27.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:27.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:27.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:28.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:28.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:28.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:28.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:29.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:29.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:29.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:29.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:30.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:30.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:30.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:30.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:31.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:31.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:31.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:31.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:32.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:32.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:32.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:32.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:33.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:33.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:33.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:33.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:34.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:34.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:34.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:34.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:35.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:35.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:35.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:35.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:36.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:36.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:36.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:36.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:37.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:37.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:37.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:37.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:38.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:38.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:38.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:38.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:39.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:39.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:39.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:39.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:40.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:40.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:40.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:40.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:41.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:41.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:41.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:41.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:42.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:42.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:42.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:42.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:43.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:43.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:44.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:44.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:44.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:44.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:45.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:45.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:45.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:45.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:46.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:46.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:46.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:46.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:46.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:46.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:48.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:47.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:48.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:48.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:49.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:48.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:49.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:49.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:49.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:49.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:50.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:50.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:51.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:50.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:51.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:50.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:51.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:51.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:52.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:52.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:52.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:52.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:53.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:53.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:53.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:53.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:53.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:53.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:54.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:54.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:54.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:54.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:55.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:55.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:55.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:55.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:56.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:56.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:56.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:56.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:57.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:57.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:58.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:57.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:58.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:58.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:59.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:52:59.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:52:59.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:52:59.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:00.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:00.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:00.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:00.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:01.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:01.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:01.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:01.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:02.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:02.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:02.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:02.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:03.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:03.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:03.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:03.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:04.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:04.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:04.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:04.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:05.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:05.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:05.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:05.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:06.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:06.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:06.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:06.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:07.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:07.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:07.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:07.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:08.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:08.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:08.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:08.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:09.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:09.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:09.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:09.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:10.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:10.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:10.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:10.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:11.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:10.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:11.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:11.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:12.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:12.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:12.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:12.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:13.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:13.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:13.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:13.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:14.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:14.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:14.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:14.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:15.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:15.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:15.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:15.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:16.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:16.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:16.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:16.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:17.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:17.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:18.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:18.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:18.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:18.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:19.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:19.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:19.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:19.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:20.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:20.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:20.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:20.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:21.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:21.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:21.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:21.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:22.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:22.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:22.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:22.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:23.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:23.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:23.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:23.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:24.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:24.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:24.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:24.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:25.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:25.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:25.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:25.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:26.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:26.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:26.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:26.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:27.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:26.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:27.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:27.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:27.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:27.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:28.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:28.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:29.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:29.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:29.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:29.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:30.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:30.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:30.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:30.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:31.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:31.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:31.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:31.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:32.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:32.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:32.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:32.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:33.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:33.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:33.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:33.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:34.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:34.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:34.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:34.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:35.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:35.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:35.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:35.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:36.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:36.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:36.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:36.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:37.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:37.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:37.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:37.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:38.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:38.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:38.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:38.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:39.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:39.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:39.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:39.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:40.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:40.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:40.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:40.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:41.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:41.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:41.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:41.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:42.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:42.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:42.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:42.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:43.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:43.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:43.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:43.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:44.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:44.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:44.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:44.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:45.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:45.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:45.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:45.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:46.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:46.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:46.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:46.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:47.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:47.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:47.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:47.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:48.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:48.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:48.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:48.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:49.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:49.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:49.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:49.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:50.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:50.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:50.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:50.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:51.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:51.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:51.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:51.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:52.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:52.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:52.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:52.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:53.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:53.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:53.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:53.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:54.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:54.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:54.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:54.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:55.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:55.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:55.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:55.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:56.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:56.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:56.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:56.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:57.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:57.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:57.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:57.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:58.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:58.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:58.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:58.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:59.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:53:59.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:53:59.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:53:59.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:00.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:00.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:00.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:00.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:01.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:01.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:01.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:01.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:02.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:02.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:02.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:02.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:03.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:03.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:03.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:03.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:04.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:04.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:04.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:04.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:05.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:05.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:05.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:05.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:06.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:06.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:06.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:06.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:07.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:07.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:07.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:07.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:08.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:08.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:08.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:08.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:09.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:09.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:09.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:09.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:10.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:10.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:10.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:10.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:11.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:11.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:11.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:11.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:12.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:12.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:12.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:12.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:13.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:13.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:13.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:13.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:14.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:14.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:14.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:14.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:15.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:15.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:15.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:15.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:16.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:16.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:16.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:16.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:17.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:17.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:17.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:17.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:18.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:18.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:18.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:18.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:19.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:19.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:19.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:19.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:20.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:20.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:20.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:20.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:21.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:21.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:21.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:21.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:22.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:22.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:22.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:22.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:23.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:23.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:23.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:23.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:24.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:24.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:24.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:24.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:25.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:25.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:25.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:25.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:26.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:26.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:26.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:26.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:27.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:27.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:27.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:27.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:28.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:28.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:28.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:28.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:29.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:29.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:29.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:29.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:30.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:30.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:30.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:30.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:31.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:31.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:31.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:31.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:32.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:32.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:32.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:32.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:33.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:33.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:33.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:33.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:34.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:34.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:34.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:34.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:35.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:35.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:35.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:35.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:36.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:36.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:36.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:36.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:37.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:37.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:37.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:37.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:38.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:38.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:38.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:38.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:39.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:39.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:39.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:39.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:40.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:40.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:40.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:40.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:41.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:41.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:41.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:41.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:42.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:42.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:42.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:42.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:43.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:43.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:43.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:43.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:44.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:44.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:44.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:44.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:45.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:45.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:45.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:45.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:46.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:46.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:46.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:46.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:47.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:47.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:47.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:47.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:48.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:48.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:48.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:48.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:49.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:49.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:49.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:49.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:50.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:50.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:50.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:50.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:51.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:51.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:51.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:51.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:52.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:52.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:52.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:52.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:53.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:53.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:53.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:53.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:54.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:54.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:54.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:54.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:55.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:55.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:55.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:55.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:56.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:56.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:56.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:56.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:57.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:57.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:57.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:57.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:58.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:58.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:58.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:58.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:59.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:54:59.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:54:59.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:54:59.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:00.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:00.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:00.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:00.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:01.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:01.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:01.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:01.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:02.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:02.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:02.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:02.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:03.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:03.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:03.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:03.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:04.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:04.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:04.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:04.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:05.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:05.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:05.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:05.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:06.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:06.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:06.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:06.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:07.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:07.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:07.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:07.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:08.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:08.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:08.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:08.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:09.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:09.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:09.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:09.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:10.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:10.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:10.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:10.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:11.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:11.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:11.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:11.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:12.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:12.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:12.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:12.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:13.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:13.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:13.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:13.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:14.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:14.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:14.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:14.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:15.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:15.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:15.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:15.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:16.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:16.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:16.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:16.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:17.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:17.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:17.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:17.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:18.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:18.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:18.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:18.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:19.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:19.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:19.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:19.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:20.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:20.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:20.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:20.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:21.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:21.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:21.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:21.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:22.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:22.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:22.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:22.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:23.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:23.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:23.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:23.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:24.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:24.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:24.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:24.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:25.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:25.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:25.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:25.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:26.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:26.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:26.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:26.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:27.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:27.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:27.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:27.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:28.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:28.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:28.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:28.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:29.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:29.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:29.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:29.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:30.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:30.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:30.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:30.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:31.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:31.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:31.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:31.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:32.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:32.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:32.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:32.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:33.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:33.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:33.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:33.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:34.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:34.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:34.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:34.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:35.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:35.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:35.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:35.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:36.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:36.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:36.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:36.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:37.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:37.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:37.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:37.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:38.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:38.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:38.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:38.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:39.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:39.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:39.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:39.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:40.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:40.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:40.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:40.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:41.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:41.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:41.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:41.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:42.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:42.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:42.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:42.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:43.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:43.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:43.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:43.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:44.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:44.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:44.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:44.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:45.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:45.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:45.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:45.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:46.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:46.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:46.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:46.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:47.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:47.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:47.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:47.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:48.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:48.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:48.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:48.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:49.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:49.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:49.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:49.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:50.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:50.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:50.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:50.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:51.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:51.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:51.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:51.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:52.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:52.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:52.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:52.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:53.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:53.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:53.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:53.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:54.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:54.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:54.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:54.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:55.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:55.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:55.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:55.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:56.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:56.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:56.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:56.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:57.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:57.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:57.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:57.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:58.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:58.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:58.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:58.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:59.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:55:59.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:55:59.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:55:59.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:00.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:00.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:00.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:00.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:01.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:01.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:01.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:01.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:02.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:02.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:02.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:02.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:03.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:03.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:03.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:03.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:04.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:04.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:04.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:04.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:05.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:05.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:05.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:05.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:06.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:06.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:06.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:06.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:07.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:07.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:07.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:07.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:08.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:08.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:08.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:08.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:09.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:09.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:09.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:09.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:10.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:10.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:10.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:10.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:11.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:11.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:11.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:11.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:12.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:12.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:12.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:12.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:13.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:13.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:13.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:13.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:14.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:14.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:14.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:14.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:15.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:15.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:15.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:15.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:16.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:16.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:16.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:16.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:17.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:17.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:17.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:17.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:18.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:18.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:18.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:18.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:19.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:19.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:19.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:19.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:20.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:20.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:20.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:20.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:21.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:21.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:21.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:21.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:22.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:22.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:22.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:22.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:23.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:23.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:23.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:23.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:24.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:24.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:24.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:24.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:25.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:25.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:25.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:25.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:26.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:26.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:26.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:26.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:27.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:27.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:27.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:27.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:28.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:28.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:28.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:28.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:29.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:29.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:29.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:29.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:30.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:30.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:30.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:30.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:31.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:31.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:31.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:31.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:32.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:32.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:32.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:32.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:33.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:33.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:33.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:33.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:34.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:34.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:35.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:35.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:35.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:35.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:36.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:36.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:36.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:36.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:36.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:36.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:37.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:37.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:38.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:38.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:38.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:38.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:39.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:38.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:39.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:39.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:40.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:40.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:40.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:40.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:41.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:41.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:41.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:41.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:42.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:42.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:42.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:42.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:43.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:43.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:43.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:43.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:44.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:44.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:44.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:44.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:45.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:45.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:45.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:45.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:46.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:46.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:46.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:46.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:47.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:47.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:47.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:47.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:48.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:48.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:48.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:48.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:49.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:49.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:49.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:49.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:50.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:50.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:50.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:50.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:51.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:51.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:51.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:51.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:52.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:52.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:52.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:52.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:53.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:53.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:53.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:53.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:54.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:54.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:54.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:54.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:55.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:55.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:55.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:55.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:56.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:56.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:56.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:56.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:57.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:57.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:57.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:57.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:58.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:58.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:58.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:58.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:59.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:56:59.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:56:59.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:56:59.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:00.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:00.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:00.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:00.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:01.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:01.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:01.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:01.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:02.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:02.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:02.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:02.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:03.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:03.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:03.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:03.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:04.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:04.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:04.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:04.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:05.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:05.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:05.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:05.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:06.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:06.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:06.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:06.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:07.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:07.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:07.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:07.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:08.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:08.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:08.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:08.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:09.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:09.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:09.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:09.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:10.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:10.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:10.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:10.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:11.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:11.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:11.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:11.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:12.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:12.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:12.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:12.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:13.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:13.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:13.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:13.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:14.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:14.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:14.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:14.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:15.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:15.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:15.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:15.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:16.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:16.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:16.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:16.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:17.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:17.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:17.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:17.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:18.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:18.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:18.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:18.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:19.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:19.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:19.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:19.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:20.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:20.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:20.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:20.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:21.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:21.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:21.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:21.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:22.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:22.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:22.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:22.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:23.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:23.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:23.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:23.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:24.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:24.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:24.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:24.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:25.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:25.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:25.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:25.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:26.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:26.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:26.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:26.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:27.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:27.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:27.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:27.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:28.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:28.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:28.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:28.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:29.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:29.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:29.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:29.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:30.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:30.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:30.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:30.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:31.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:31.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:31.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:31.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:32.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:32.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:32.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:32.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:33.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:33.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:33.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:33.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:34.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:34.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:34.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:34.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:35.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:35.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:35.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:35.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:36.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:36.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:36.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:36.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:37.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:37.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:37.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:37.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:38.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:38.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:38.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:38.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:39.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:39.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:39.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:39.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:40.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:40.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:40.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:40.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:41.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:41.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:41.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:41.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:42.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:42.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:42.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:42.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:43.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:43.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:43.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:43.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:44.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:44.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:44.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:44.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:45.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:45.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:45.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:45.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:46.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:46.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:46.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:46.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:47.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:47.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:47.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:47.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:48.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:48.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:48.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:48.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:49.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:49.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:49.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:49.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:50.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:50.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:50.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:50.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:51.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:51.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:51.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:51.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:52.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:52.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:52.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:52.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:53.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:53.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:53.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:53.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:54.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:54.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:54.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:54.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:55.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:55.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:55.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:55.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:56.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:56.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:56.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:56.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:57.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:57.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:57.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:57.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:58.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:58.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:58.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:58.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:59.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:57:59.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:57:59.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:57:59.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:00.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:00.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:00.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:00.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:01.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:01.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:01.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:01.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:02.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:02.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:02.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:02.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:03.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:03.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:03.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:03.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:04.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:04.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:04.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:04.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:05.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:05.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:05.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:05.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:06.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:06.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:06.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:06.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:07.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:07.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:07.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:07.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:08.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:08.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:08.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:08.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:09.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:09.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:09.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:09.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:10.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:10.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:10.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:10.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:11.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:11.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:11.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:11.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:12.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:12.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:12.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:12.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:13.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:13.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:13.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:13.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:14.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:14.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:14.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:14.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:15.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:15.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:15.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:15.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:16.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:16.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:16.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:16.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:17.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:17.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:17.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:17.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:18.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:18.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:18.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:18.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:19.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:19.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:19.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:19.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:20.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:20.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:20.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:20.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:21.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:21.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:21.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:21.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:22.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:22.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:22.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:22.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:23.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:23.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:23.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:23.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:24.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:24.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:24.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:24.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:25.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:25.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:25.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:25.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:26.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:26.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:26.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:26.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:27.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:27.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:27.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:27.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:28.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:28.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:28.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:28.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:29.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:29.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:29.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:29.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:30.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:30.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:30.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:30.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:31.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:31.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:31.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:31.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:32.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:32.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:32.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:32.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:33.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:33.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:33.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:33.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:34.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:34.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:34.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:34.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:35.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:35.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:35.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:35.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:36.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:36.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:36.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:36.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:37.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:37.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:37.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:37.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:38.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:38.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:38.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:38.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:39.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:39.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:39.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:39.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:40.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:40.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:40.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:40.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:41.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:41.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:41.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:41.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:42.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:42.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:42.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:42.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:43.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:43.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:43.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:43.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:44.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:44.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:44.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:44.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:45.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:45.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:45.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:45.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:46.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:46.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:46.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:46.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:47.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:47.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:47.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:47.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:48.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:48.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:48.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:48.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:49.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:49.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:49.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:49.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:50.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:50.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:50.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:50.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:51.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:51.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:51.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:51.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:52.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:52.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:52.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:52.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:53.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:53.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:53.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:53.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:54.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:54.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:54.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:54.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:55.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:55.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:55.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:55.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:56.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:56.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:56.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:56.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:57.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:57.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:57.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:57.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:58.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:58.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:58.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:58.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:59.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:58:59.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:58:59.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:58:59.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:00.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:00.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:00.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:00.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:01.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:01.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:01.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:01.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:02.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:02.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:02.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:02.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:03.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:03.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:03.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:03.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:04.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:04.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:04.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:04.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:05.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:05.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:05.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:05.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:06.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:06.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:06.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:06.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:07.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:07.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:07.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:07.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:08.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:08.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:08.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:08.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:09.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:09.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:09.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:09.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:10.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:10.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:10.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:10.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:11.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:11.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:11.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:11.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:12.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:12.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:12.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:12.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:13.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:13.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:13.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:13.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:14.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:14.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:14.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:14.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:15.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:15.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:15.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:15.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:16.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:16.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:16.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:16.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:17.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:17.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:17.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:17.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:18.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:18.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:18.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:18.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:19.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:19.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:19.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:19.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:20.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:20.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:20.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:20.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:21.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:21.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:21.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:21.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:22.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:22.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:22.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:22.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:23.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:23.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:23.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:23.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:24.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:24.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:24.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:24.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:25.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:25.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:25.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:25.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:26.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:26.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:26.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:26.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:27.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:27.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:27.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:27.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:28.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:28.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:28.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:28.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:29.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:29.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:29.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:29.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:30.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:30.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:30.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:30.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:31.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:31.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:31.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:31.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:32.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:32.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:32.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:32.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:33.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:33.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:33.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:33.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:34.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:34.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:34.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:34.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:35.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:35.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:35.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:35.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:36.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:36.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:36.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:36.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:37.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:37.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:37.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:37.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:38.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:38.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:38.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:38.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:39.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:39.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:39.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:39.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:40.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:40.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:40.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:40.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:41.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:41.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:41.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:41.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:42.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:42.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:42.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:42.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:43.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:43.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:43.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:43.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:44.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:44.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:44.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:44.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:45.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:45.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:45.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:45.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:46.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:46.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:46.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:46.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:47.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:47.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:47.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:47.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:48.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:48.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:48.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:48.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:49.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:49.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:49.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:49.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:50.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:50.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:50.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:50.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:51.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:51.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:51.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:51.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:52.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:52.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:52.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:52.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:53.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:53.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:53.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:53.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:54.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:54.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:54.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:54.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:55.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:55.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:55.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:55.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:56.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:56.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:56.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:56.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:57.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:57.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:57.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:57.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:58.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:58.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:58.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:58.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:59.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T02:59:59.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T02:59:59.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T02:59:59.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:00.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:00.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:00.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:00.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:01.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:01.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:01.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:01.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:02.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:02.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:02.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:02.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:03.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:03.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:03.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:03.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:04.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:04.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:04.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:04.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:05.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:05.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:05.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:05.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:06.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:06.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:06.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:06.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:07.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:07.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:07.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:07.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:08.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:08.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:08.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:08.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:09.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:09.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:09.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:09.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:10.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:10.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:10.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:10.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:11.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:11.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:11.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:11.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:12.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:12.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:12.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:12.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:13.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:13.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:13.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:13.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:14.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:14.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:14.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:14.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:15.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:15.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:15.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:15.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:16.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:16.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:16.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:16.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:17.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:17.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:17.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:17.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:18.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:18.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:18.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:18.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:19.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:19.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:19.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:19.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:20.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:20.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:20.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:20.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:21.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:21.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:21.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:21.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:22.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:22.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:22.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:22.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:23.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:23.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:23.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:23.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:24.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:24.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:24.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:24.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:25.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:25.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:25.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:25.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:26.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:26.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:26.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:26.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:27.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:27.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:27.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:27.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:28.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:28.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:28.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:28.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:29.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:29.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:29.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:29.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:30.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:30.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:30.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:30.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:31.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:31.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:31.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:31.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:32.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:32.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:32.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:32.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:33.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:33.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:34.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:34.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:34.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:34.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:35.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:34.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:35.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:35.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:36.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:36.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:36.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:36.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:37.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:37.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:37.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:37.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:38.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:38.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:38.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:38.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:38.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:38.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:39.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:39.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:40.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:39.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:40.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:40.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:41.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:41.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:41.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:41.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:41.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:41.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:42.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:42.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:42.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:42.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:43.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:43.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:44.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:43.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:44.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:44.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:45.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:45.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:45.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:45.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:46.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:46.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:46.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:46.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:46.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:46.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:47.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:47.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:47.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:48.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:48.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:48.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:48.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:49.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:49.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:50.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:50.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:50.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:51.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:51.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:51.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:51.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:52.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:52.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:52.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:52.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:53.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:53.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:53.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:53.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:54.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:54.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:54.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:54.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:55.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:55.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:55.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:55.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:56.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:56.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:56.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:56.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:57.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:57.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:57.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:57.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:58.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:58.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:58.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:58.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:59.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:00:59.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:00:59.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:00:59.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:00.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:00.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:00.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:00.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:01.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:01.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:01.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:01.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:02.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:02.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:02.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:02.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:03.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:03.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:03.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:03.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:04.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:04.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:04.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:04.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:05.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:05.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:05.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:05.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:06.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:06.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:06.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:06.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:07.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:07.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:07.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:07.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:08.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:08.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:08.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:08.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:09.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:09.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:09.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:09.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:10.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:10.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:10.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:10.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:11.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:11.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:11.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:11.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:12.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:12.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:12.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:12.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:13.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:13.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:13.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:13.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:14.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:14.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:14.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:14.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:15.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:15.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:15.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:15.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:16.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:16.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:16.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:16.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:17.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:17.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:17.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:17.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:18.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:18.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:18.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:18.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:19.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:19.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:19.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:19.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:20.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:20.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:20.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:20.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:21.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:21.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:21.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:21.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:22.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:22.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:22.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:22.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:23.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:23.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:23.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:23.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:24.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:24.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:24.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:24.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:25.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:25.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:25.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:25.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:26.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:26.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:26.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:26.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:27.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:27.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:27.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:27.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:28.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:28.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:28.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:28.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:29.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:29.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:29.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:29.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:30.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:30.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:30.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:30.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:31.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:31.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:31.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:31.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:32.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:32.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:32.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:32.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:33.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:33.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:33.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:33.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:34.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:34.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:34.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:34.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:35.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:35.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:35.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:35.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:36.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:36.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:36.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:36.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:37.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:37.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:37.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:37.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:38.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:38.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:38.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:38.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:39.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:39.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:39.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:39.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:40.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:40.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:40.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:40.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:41.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:41.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:41.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:41.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:42.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:42.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:42.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:42.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:43.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:43.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:43.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:43.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:44.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:44.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:44.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:44.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:45.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:45.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:45.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:45.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:46.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:46.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:46.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:46.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:47.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:47.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:47.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:47.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:48.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:48.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:48.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:48.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:49.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:49.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:49.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:49.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:50.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:50.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:50.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:50.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:51.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:51.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:51.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:51.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:52.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:52.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:52.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:52.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:53.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:53.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:53.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:53.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:54.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:54.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:54.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:54.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:55.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:55.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:55.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:55.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:56.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:56.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:56.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:57.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:57.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:57.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:57.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:58.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:58.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:58.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:58.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:59.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:01:59.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:01:59.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:01:59.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:00.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:00.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:00.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:00.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:01.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:01.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:01.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:01.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:02.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:02.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:02.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:02.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:03.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:03.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:03.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:03.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:04.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:04.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:04.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:04.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:05.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:05.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:05.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:05.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:06.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:06.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:06.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:06.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:07.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:07.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:07.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:07.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:08.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:08.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:08.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:08.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:09.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:09.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:09.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:09.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:10.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:10.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:10.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:10.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:11.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:11.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:11.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:11.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:12.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:12.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:12.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:12.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:13.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:13.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:13.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:13.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:14.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:14.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:14.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:14.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:15.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:15.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:15.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:15.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:16.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:16.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:16.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:16.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:17.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:17.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:17.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:17.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:18.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:18.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:18.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:18.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:19.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:19.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:19.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:19.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:20.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:20.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:20.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:20.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:21.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:21.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:21.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:21.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:22.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:22.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:22.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:22.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:23.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:23.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:23.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:23.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:24.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:24.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:24.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:24.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:25.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:25.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:25.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:25.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:26.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:26.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:26.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:26.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:27.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:27.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:27.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:27.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:28.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:28.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:28.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:28.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:29.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:29.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:29.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:29.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:30.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:30.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:30.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:30.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:31.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:31.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:31.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:31.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:32.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:32.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:32.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:32.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:33.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:33.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:33.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:33.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:34.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:34.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:34.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:34.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:35.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:35.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:35.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:35.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:36.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:36.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:36.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:36.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:37.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:37.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:37.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:37.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:38.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:38.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:38.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:38.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:39.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:39.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:39.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:39.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:40.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:40.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:40.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:40.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:41.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:41.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:41.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:41.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:42.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:42.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:42.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:42.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:43.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:43.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:43.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:43.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:44.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:44.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:44.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:44.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:45.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:45.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:45.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:45.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:46.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:46.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:46.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:46.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:47.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:47.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:47.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:47.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:48.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:48.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:48.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:48.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:49.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:49.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:49.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:49.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:50.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:50.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:50.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:50.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:51.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:51.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:51.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:51.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:52.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:52.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:52.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:52.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:53.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:53.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:53.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:53.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:54.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:54.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:54.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:54.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:55.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:55.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:55.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:55.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:56.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:56.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:56.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:56.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:57.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:57.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:57.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:57.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:58.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:58.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:58.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:58.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:59.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:02:59.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:02:59.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:02:59.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:00.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:00.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:00.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:00.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:01.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:01.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:01.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:01.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:02.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:02.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:02.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:02.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:03.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:03.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:03.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:03.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:04.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:04.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:04.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:04.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:05.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:05.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:05.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:05.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:06.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:06.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:06.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:06.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:07.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:07.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:07.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:07.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:08.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:08.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:08.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:08.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:09.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:09.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:09.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:09.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:10.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:10.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:10.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:10.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:11.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:11.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:11.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:11.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:12.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:12.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:12.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:12.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:13.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:13.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:13.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:13.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:14.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:14.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:14.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:14.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:15.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:15.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:15.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:15.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:16.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:16.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:16.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:16.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:17.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:17.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:17.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:17.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:18.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:18.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:18.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:18.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:19.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:19.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:19.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:19.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:20.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:20.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:20.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:20.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:21.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:21.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:21.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:21.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:22.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:22.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:22.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:22.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:23.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:23.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:23.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:23.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:24.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:24.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:24.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:24.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:25.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:25.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:25.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:25.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:26.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:26.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:26.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:26.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:27.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:27.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:27.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:27.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:28.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:28.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:28.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:28.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:29.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:29.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:29.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:29.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:30.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:30.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:30.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:30.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:31.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:31.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:31.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:31.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:32.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:32.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:32.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:32.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:33.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:33.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:33.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:33.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:34.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:34.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:34.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:34.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:35.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:35.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:35.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:35.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:36.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:36.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:36.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:36.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:37.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:37.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:37.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:37.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:38.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:38.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:38.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:38.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:39.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:39.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:39.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:39.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:40.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:40.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:40.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:40.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:41.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:41.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:41.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:41.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:42.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:42.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:42.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:42.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:43.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:43.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:43.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:43.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:44.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:44.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:44.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:44.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:45.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:45.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:45.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:45.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:46.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:46.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:46.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:46.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:47.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:47.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:47.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:47.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:48.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:48.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:48.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:48.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:49.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:49.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:49.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:49.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:50.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:50.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:50.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:50.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:51.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:51.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:51.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:51.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:52.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:52.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:52.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:52.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:53.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:53.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:53.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:53.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:54.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:54.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:54.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:54.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:55.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:55.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:55.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:55.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:56.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:56.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:56.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:56.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:57.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:57.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:57.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:57.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:58.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:58.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:58.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:58.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:59.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:03:59.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:03:59.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:03:59.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:00.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:00.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:00.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:00.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:01.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:01.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:01.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:01.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:02.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:02.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:02.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:02.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:03.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:03.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:03.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:03.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:04.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:04.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:04.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:04.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:05.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:05.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:05.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:05.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:06.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:06.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:06.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:06.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:07.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:07.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:07.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:07.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:08.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:08.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:08.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:08.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:09.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:09.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:09.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:09.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:10.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:10.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:10.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:10.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:11.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:11.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:11.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:11.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:12.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:12.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:12.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:12.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:13.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:13.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:13.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:13.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:14.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:14.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:14.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:14.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:15.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:15.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:15.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:15.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:16.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:16.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:16.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:16.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:17.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:17.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:17.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:17.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:18.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:18.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:18.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:18.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:19.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:19.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:19.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:19.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:20.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:20.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:20.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:20.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:21.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:21.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:21.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:21.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:22.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:22.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:22.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:22.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:23.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:23.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:23.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:23.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:24.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:24.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:24.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:24.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:25.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:25.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:25.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:25.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:26.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:26.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:26.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:26.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:27.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:27.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:27.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:27.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:28.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:28.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:28.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:28.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:29.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:29.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:29.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:29.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:30.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:30.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:30.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:30.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:31.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:31.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:31.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:31.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:32.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:32.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:32.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:32.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:33.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:33.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:33.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:33.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:34.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:34.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:34.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:34.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:35.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:35.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:35.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:35.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:36.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:36.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:36.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:36.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:37.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:37.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:37.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:37.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:38.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:38.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:38.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:38.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:39.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:39.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:39.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:39.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:40.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:40.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:40.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:40.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:41.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:41.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:41.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:41.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:42.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:42.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:42.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:42.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:43.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:43.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:43.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:43.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:44.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:44.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:44.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:44.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:45.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:45.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:45.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:45.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:46.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:46.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:46.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:46.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:47.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:47.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:47.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:47.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:48.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:48.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:48.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:48.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:49.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:49.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:49.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:49.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:50.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:50.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:50.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:50.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:51.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:51.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:51.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:51.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:52.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:52.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:52.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:52.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:53.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:53.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:53.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:53.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:54.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:54.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:54.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:54.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:55.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:55.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:55.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:55.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:56.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:56.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:56.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:56.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:57.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:57.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:57.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:57.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:58.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:58.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:58.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:58.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:59.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:04:59.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:04:59.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:04:59.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:00.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:00.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:00.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:00.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:01.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:01.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:01.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:01.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:02.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:02.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:02.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:02.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:03.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:03.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:03.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:03.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:04.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:04.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:04.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:04.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:05.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:05.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:05.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:05.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:06.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:06.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:06.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:06.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:07.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:07.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:07.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:07.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:08.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:08.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:08.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:08.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:09.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:09.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:09.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:09.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:10.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:10.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:10.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:10.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:11.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:11.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:11.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:11.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:12.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:12.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:12.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:12.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:13.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:13.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:13.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:13.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:14.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:14.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:14.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:14.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:15.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:15.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:15.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:15.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:16.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:16.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:16.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:16.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:17.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:17.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:17.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:17.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:18.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:18.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:18.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:18.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:19.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:19.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:19.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:19.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:20.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:20.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:20.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:20.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:21.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:21.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:21.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:21.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:22.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:22.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:22.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:22.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:23.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:23.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:23.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:23.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:24.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:24.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:24.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:24.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:25.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:25.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:25.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:25.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:26.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:26.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:26.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:26.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:27.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:27.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:27.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:27.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:28.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:28.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:28.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:28.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:29.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:29.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:29.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:29.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:30.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:30.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:30.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:30.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:31.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:31.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:31.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:31.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:32.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:32.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:32.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:32.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:33.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:33.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:33.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:33.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:34.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:34.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:34.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:34.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:35.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:35.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:35.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:35.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:36.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:36.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:36.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:36.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:37.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:37.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:37.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:37.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:38.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:38.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:38.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:38.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:39.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:39.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:39.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:39.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:40.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:40.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:40.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:40.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:41.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:41.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:41.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:41.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:42.076 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T03:05:42.067+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fa40e6650 msgr2=0x7f5fa40c32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-20T03:05:42.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:42.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:42.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:42.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:43.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:43.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:43.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:43.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:44.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:44.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:44.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:44.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:45.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:45.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:45.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:45.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:46.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:46.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:46.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:46.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:47.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:47.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:47.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:47.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:48.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:48.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:48.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:48.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:49.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:49.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:49.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:49.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:50.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:50.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:50.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:50.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:51.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:51.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:51.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:51.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:52.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:52.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:52.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:52.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:53.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:53.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:53.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:53.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:54.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:54.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:54.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:54.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:55.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:55.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:55.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:55.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:56.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:56.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:56.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:56.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:57.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:57.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:57.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:57.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:58.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:58.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:58.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:58.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:59.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:05:59.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:05:59.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:05:59.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:00.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:00.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:00.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:00.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:01.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:01.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:01.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:01.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:02.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:02.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:02.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:02.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:03.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:03.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:03.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:03.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:04.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:04.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:04.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:04.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:05.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:05.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:05.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:05.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:06.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:06.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:06.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:06.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:07.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:07.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:07.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:07.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:08.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:08.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:08.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:08.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:09.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:09.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:09.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:09.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:10.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:10.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:10.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:10.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:11.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:11.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:11.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:11.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:12.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:12.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:12.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:12.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:13.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:13.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:13.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:13.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:14.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:14.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:14.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:14.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:15.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:15.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:15.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:15.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:16.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:16.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:16.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:16.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:17.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:17.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:17.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:17.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:18.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:18.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:18.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:18.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:19.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:19.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:19.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:19.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:20.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:20.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:20.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:20.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:21.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:21.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:21.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:21.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:22.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:22.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:22.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:22.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:23.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:23.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:23.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:23.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:24.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:24.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:24.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:24.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:25.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:25.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:25.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:25.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:26.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:26.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:26.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:26.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:27.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:27.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:27.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:27.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:28.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:28.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:28.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:28.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:29.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:29.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:29.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:29.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:30.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:30.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:30.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:30.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:31.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:31.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:31.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:31.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:32.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:32.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:32.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:32.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:33.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:33.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:33.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:33.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:34.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:34.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:34.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:34.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:35.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:35.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:35.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:35.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:36.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:36.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:36.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:36.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:37.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:37.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:37.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:37.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:38.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:38.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:38.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:39.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:39.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:39.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:39.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:40.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:40.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:40.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:40.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:41.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:41.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:41.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:41.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:42.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:42.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:42.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:42.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:43.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:43.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:43.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:43.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:44.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:44.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:44.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:44.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:45.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:45.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:45.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:45.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:46.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:46.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:46.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:46.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:47.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:47.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:47.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:47.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:48.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:48.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:48.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:48.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:49.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:49.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:49.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:49.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:50.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:50.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:50.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:50.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:51.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:51.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:51.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:51.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:52.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:52.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:52.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:52.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:53.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:53.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:53.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:53.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:54.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:54.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:54.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:54.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:55.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:55.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:55.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:55.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:56.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:56.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:56.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:56.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:57.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:57.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:57.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:57.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:58.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:58.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:58.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:58.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:59.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:06:59.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:06:59.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:06:59.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:00.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:00.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:00.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:00.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:01.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:01.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:01.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:01.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:02.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:02.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:02.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:02.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:03.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:03.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:03.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:03.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:04.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:04.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:04.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:04.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:05.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:05.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:05.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:05.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:06.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:06.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:06.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:06.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:07.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:07.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:07.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:07.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:08.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:08.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:08.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:08.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:09.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:09.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:09.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:09.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:10.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:10.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:10.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:10.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:11.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:11.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:11.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:11.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:12.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:12.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:12.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:12.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:13.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:13.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:13.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:13.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:14.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:14.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:14.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:14.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:15.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:15.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:15.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:15.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:16.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:16.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:16.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:16.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:17.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:17.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:17.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:17.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:18.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:18.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:18.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:18.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:19.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:19.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:19.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:19.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:20.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:20.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:20.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:20.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:21.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:21.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:21.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:21.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:22.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:22.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:22.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:22.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:23.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:23.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:23.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:23.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:24.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:24.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:24.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:24.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:25.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:25.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:25.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:25.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:26.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:26.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:26.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:26.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:27.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:27.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:27.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:27.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:28.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:28.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:28.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:28.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:29.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:29.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:29.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:29.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:30.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:30.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:30.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:30.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:31.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:31.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:31.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:31.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:32.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:32.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:33.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:33.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:33.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:33.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:34.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:34.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:34.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:34.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:35.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:35.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:35.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:35.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:36.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:36.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:36.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:36.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:37.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:37.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:37.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:37.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:38.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:38.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:38.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:38.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:39.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:39.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:39.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:39.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:40.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:40.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:40.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:40.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:41.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:41.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:41.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:41.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:42.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:42.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:42.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:42.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:43.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:43.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:43.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:43.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:44.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:44.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:44.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:44.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:45.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:45.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:45.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:45.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:46.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:46.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:46.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:46.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:47.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:47.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:47.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:47.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:48.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:48.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:48.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:48.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:49.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:49.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:49.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:49.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:50.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:50.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:50.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:50.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:51.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:51.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:51.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:51.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:52.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:52.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:52.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:52.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:53.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:53.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:53.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:53.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:54.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:54.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:54.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:54.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:55.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:55.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:55.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:55.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:56.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:56.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:56.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:56.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:57.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:57.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:57.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:57.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:58.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:58.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:58.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:58.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:59.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:59.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:07:59.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:07:59.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:00.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:07:59.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:00.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:00.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:00.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:00.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:01.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:01.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:01.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:01.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:02.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:02.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:02.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:02.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:03.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:03.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:04.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:03.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:04.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:04.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:04.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:04.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:05.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:05.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:05.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:05.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:06.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:06.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:06.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:06.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:07.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:07.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:07.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:07.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:08.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:08.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:08.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:08.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:09.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:09.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:09.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:09.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:10.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:10.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:10.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:10.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:11.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:11.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:11.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:11.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:12.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:12.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:12.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:12.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:13.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:13.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:13.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:13.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:14.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:14.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:14.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:14.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:15.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:15.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:15.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:15.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:16.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:16.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:16.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:16.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:17.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:17.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:17.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:17.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:18.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:18.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:18.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:18.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:19.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:19.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:19.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:19.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:20.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:20.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:20.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:20.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:21.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:21.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:21.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:21.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:22.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:22.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:22.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:22.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:23.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:23.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:23.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:23.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:24.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:24.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:25.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:24.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:25.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:25.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:26.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:25.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:26.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:26.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:26.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:26.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:27.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:27.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:27.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:27.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:28.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:28.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:28.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:28.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:29.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:29.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:29.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:29.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:30.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:30.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:30.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:30.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:31.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:31.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:31.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:31.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:32.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:32.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:32.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:32.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:33.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:33.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:33.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:33.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:34.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:34.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:34.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:34.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:35.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:35.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:35.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:35.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:36.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:36.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:36.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:36.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:37.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:37.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:37.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:37.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:38.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:38.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:38.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:38.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:39.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:39.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:39.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:39.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:40.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:40.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:40.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:40.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:41.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:41.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:41.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:41.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:42.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:42.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:42.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:42.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:43.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:43.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:43.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:43.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:44.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:44.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:44.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:44.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:45.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:45.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:45.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:45.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:46.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:46.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:46.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:46.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:47.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:47.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:47.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:47.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:48.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:48.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:48.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:48.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:49.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:49.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:49.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:49.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:50.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:50.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:50.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:50.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:51.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:51.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:52.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:52.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:52.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:52.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:53.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:53.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:53.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:53.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:54.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:54.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:54.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:54.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:54.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:54.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:55.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:55.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:55.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:55.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:56.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:56.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:56.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:56.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:57.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:57.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:57.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:57.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:58.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:58.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:58.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:58.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:59.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:08:59.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:08:59.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:08:59.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:00.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:00.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:00.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:00.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:01.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:01.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:01.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:01.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:02.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:02.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:02.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:02.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:03.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:03.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:03.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:03.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:04.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:04.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:04.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:04.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:05.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:05.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:05.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:05.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:06.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:06.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:06.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:06.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:07.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:07.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:07.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:07.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:08.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:08.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:08.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:08.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:09.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:09.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:09.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:09.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:10.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:10.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:10.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:10.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:11.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:11.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:11.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:11.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:12.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:12.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:12.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:12.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:13.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:13.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:13.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:13.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:14.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:14.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:14.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:14.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:15.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:15.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:15.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:15.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:16.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:16.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:16.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:16.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:17.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:17.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:17.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:17.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:18.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:18.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:18.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:18.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:19.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:19.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:19.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:19.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:20.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:20.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:20.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:20.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:21.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:21.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:21.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:21.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:22.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:22.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:22.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:22.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:23.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:23.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:23.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:23.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:24.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:24.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:24.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:24.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:25.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:25.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:25.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:25.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:26.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:26.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:26.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:26.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:27.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:27.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:27.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:27.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:28.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:28.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:28.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:28.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:29.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:29.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:29.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:29.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:30.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:30.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:30.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:30.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:31.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:31.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:31.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:31.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:32.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:32.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:32.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:32.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:33.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:33.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:33.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:33.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:34.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:34.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:34.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:34.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:35.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:35.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:35.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:35.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:36.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:36.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:36.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:36.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:37.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:37.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:37.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:37.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:38.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:38.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:38.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:38.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:39.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:39.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:39.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:39.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:40.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:40.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:40.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:40.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:41.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:41.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:41.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:41.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:42.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:42.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:42.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:42.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:43.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:43.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:43.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:43.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:44.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:44.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:44.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:44.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:45.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:45.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:45.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:45.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:46.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:46.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:46.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:46.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:47.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:47.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:47.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:47.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:48.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:48.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:48.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:48.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:49.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:49.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:49.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:49.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:50.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:50.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:50.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:50.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:51.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:51.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:51.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:51.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:52.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:52.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:52.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:52.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:53.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:53.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:53.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:53.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:54.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:54.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:54.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:54.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:55.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:55.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:55.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:55.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:56.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:56.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:56.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:56.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:57.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:57.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:58.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:58.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:58.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:58.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:59.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:59.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:59.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:09:59.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:09:59.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:09:59.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:00.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:00.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:01.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:00.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:01.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:01.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:01.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:01.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:02.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:02.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:02.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:02.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:03.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:03.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:03.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:03.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:04.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:04.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:04.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:04.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:05.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:05.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:05.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:05.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:06.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:06.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:06.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:06.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:07.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:07.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:07.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:07.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:08.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:08.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:08.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:08.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:09.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:09.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:09.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:09.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:10.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:10.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:10.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:10.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:11.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:11.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:11.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:11.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:12.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:12.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:12.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:12.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:13.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:13.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:13.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:13.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:14.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:14.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:14.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:14.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:15.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:15.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:15.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:15.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:16.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:16.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:16.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:16.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:17.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:17.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:17.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:17.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:18.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:18.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:18.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:18.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:19.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:19.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:19.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:19.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:20.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:20.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:20.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:20.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:21.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:21.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:21.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:21.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:22.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:22.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:22.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:22.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:23.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:23.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:23.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:23.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:24.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:24.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:24.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:24.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:25.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:25.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:25.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:25.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:26.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:26.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:26.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:26.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:27.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:27.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:27.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:27.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:28.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:28.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:28.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:28.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:29.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:29.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:29.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:29.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:30.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:30.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:30.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:30.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:31.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:31.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:31.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:31.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:32.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:32.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:32.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:32.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:33.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:33.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:33.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:33.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:34.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:34.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:34.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:34.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:35.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:35.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:35.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:35.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:36.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:36.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:36.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:36.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:37.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:37.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:37.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:37.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:38.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:38.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:38.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:38.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:39.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:39.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:39.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:39.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:40.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:40.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:40.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:40.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:41.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:41.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:41.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:41.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:42.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:42.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:42.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:42.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:43.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:43.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:43.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:43.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:44.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:44.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:44.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:44.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:45.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:45.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:45.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:45.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:46.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:46.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:46.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:46.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:47.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:47.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:47.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:47.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:48.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:48.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:48.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:48.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:49.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:49.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:49.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:49.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:50.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:50.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:50.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:50.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:51.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:51.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:51.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:51.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:52.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:52.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:52.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:52.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:53.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:53.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:53.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:53.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:54.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:54.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:54.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:54.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:55.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:55.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:55.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:55.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:56.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:56.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:56.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:56.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:57.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:57.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:57.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:57.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:58.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:58.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:58.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:58.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:59.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:10:59.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:10:59.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:10:59.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:00.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:00.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:00.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:00.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:01.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:01.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:01.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:01.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:02.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:02.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:02.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:02.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:03.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:03.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:03.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:03.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:04.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:04.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:04.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:04.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:05.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:05.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:05.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:05.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:06.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:06.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:06.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:06.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:07.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:07.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:07.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:07.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:08.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:08.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:09.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:08.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:09.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:09.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:09.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:09.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:10.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:10.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:10.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:10.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:11.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:11.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:11.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:11.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:12.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:12.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:12.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:12.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:13.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:13.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:14.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:14.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:14.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:14.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:14.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:14.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:15.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:15.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:15.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:15.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:16.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:16.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:16.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:16.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:17.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:17.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:17.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:17.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:18.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:18.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:18.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:18.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:19.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:19.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:19.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:19.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:20.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:20.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:20.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:20.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:21.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:21.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:22.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:22.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:22.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:22.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:22.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:22.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:23.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:23.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:23.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:23.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:24.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:24.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:25.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:25.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:25.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:25.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:26.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:26.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:26.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:26.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:27.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:27.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:27.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:27.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:28.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:28.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:28.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:28.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:29.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:29.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:29.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:29.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:29.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:29.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:30.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:30.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:30.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:30.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:31.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:31.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:31.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:31.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:32.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:32.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:32.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:32.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:33.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:33.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:34.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:33.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:34.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:34.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:34.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:34.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:35.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:35.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:35.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:35.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:36.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:36.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:36.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:36.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:37.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:37.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:37.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:37.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:38.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:38.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:38.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:38.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:39.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:39.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:40.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:40.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:40.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:40.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:40.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:40.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:41.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:41.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:41.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:41.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:42.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:42.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:42.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:42.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:43.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:43.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:43.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:43.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:44.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:44.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:44.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:44.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:45.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:45.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:45.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:45.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:46.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:46.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:46.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:46.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:47.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:47.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:47.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:47.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:48.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:48.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:48.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:48.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:49.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:49.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:49.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:49.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:50.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:50.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:50.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:50.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:51.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:51.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:51.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:51.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:52.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:52.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:52.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:52.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:53.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:53.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:53.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:53.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:54.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:54.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:54.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:54.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:55.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:55.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:55.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:55.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:56.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:56.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:56.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:56.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:57.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:57.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:57.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:57.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:58.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:58.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:58.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:58.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:59.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:11:59.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:11:59.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:11:59.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:00.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:00.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:00.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:00.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:01.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:01.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:01.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:01.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:02.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:02.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:02.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:02.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:03.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:03.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:03.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:03.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:04.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:04.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:04.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:04.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:05.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:05.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:05.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:05.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:06.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:06.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:07.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:07.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:07.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:07.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:07.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:07.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:08.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:08.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:09.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:09.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:09.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:09.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:09.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:09.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:10.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:10.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:10.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:10.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:11.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:11.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:11.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:11.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:12.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:12.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:12.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:12.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:13.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:13.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:13.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:13.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:14.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:14.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:14.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:14.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:15.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:15.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:15.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:15.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:16.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:16.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:16.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:16.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:17.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:17.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:17.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:17.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:18.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:18.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:19.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:18.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:19.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:19.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:19.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:19.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:20.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:20.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:21.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:21.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:21.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:21.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:21.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:21.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:22.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:22.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:22.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:22.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:23.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:23.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:23.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:23.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:24.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:24.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:24.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:24.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:25.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:25.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:26.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:26.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:26.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:26.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:27.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:27.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:27.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:27.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:28.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:28.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:28.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:28.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:29.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:29.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:29.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:29.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:30.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:30.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:30.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:30.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:31.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:31.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:31.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:31.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:32.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:32.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:32.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:32.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:33.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:33.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:33.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:33.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:34.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:34.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:34.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:34.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:35.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:35.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:35.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:35.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:36.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:36.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:36.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:36.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:37.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:37.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:37.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:37.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:38.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:38.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:38.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:38.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:39.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:39.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:39.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:39.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:40.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:40.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:40.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:40.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:41.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:41.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:41.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:41.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:42.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:42.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:42.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:42.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:43.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:43.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:43.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:43.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:44.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:44.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:44.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:44.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:45.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:45.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:45.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:45.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:46.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:46.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:46.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:46.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:47.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:47.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:47.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:47.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:48.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:48.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:48.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:48.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:49.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:49.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:49.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:49.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:50.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:50.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:50.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:50.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:51.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:51.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:51.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:51.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:52.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:52.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:52.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:52.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:53.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:53.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:53.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:53.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:54.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:54.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:54.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:54.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:55.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:55.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:55.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:55.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:56.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:56.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:56.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:56.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:57.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:57.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:57.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:57.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:58.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:58.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:58.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:58.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:59.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:12:59.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:12:59.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:12:59.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:00.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:00.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:00.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:00.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:01.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:01.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:01.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:01.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:02.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:02.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:02.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:02.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:03.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:03.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:03.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:03.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:04.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:04.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:04.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:04.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:05.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:05.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:05.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:05.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:06.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:06.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:06.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:06.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:07.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:07.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:07.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:07.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:08.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:08.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:08.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:08.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:08.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:08.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:09.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:09.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:09.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:09.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:10.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:10.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:10.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:10.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:11.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:11.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:11.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:11.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:12.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:12.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:12.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:12.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:13.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:13.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:14.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:14.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:14.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:14.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:15.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:15.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:15.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:15.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:16.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:16.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:16.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:16.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:17.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:17.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:17.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:17.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:18.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:18.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:18.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:18.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:19.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:19.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:19.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:19.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:20.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:20.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:20.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:20.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:21.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:21.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:21.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:21.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:22.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:22.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:22.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:22.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:23.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:23.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:23.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:23.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:24.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:24.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:24.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:24.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:25.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:25.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:25.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:25.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:26.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:26.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:26.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:26.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:27.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:27.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:27.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:27.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:28.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:28.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:29.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:28.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:29.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:29.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:30.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:30.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:30.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:30.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:31.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:31.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:31.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:31.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:31.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:31.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:32.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:32.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:32.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:32.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:33.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:33.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:34.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:33.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:34.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:34.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:35.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:35.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:35.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:35.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:36.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:36.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:36.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:36.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:37.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:37.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:37.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:37.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:37.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:37.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:38.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:38.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:38.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:38.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:39.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:39.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:39.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:39.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:40.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:40.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:40.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:40.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:41.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:41.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:41.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:41.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:42.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:42.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:42.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:42.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:43.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:43.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:43.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:43.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:44.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:44.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:44.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:44.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:45.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:45.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:45.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:45.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:46.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:46.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:47.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:47.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:47.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:47.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:48.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:48.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:48.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:48.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:49.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:49.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:49.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:49.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:50.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:50.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:50.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:50.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:51.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:51.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:51.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:51.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:52.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:51.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:52.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:52.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:52.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:52.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:53.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:53.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:53.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:53.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:54.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:54.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:54.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:54.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:55.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:55.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:56.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:56.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:56.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:56.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:56.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:56.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:57.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:57.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:57.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:57.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:58.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:58.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:58.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:58.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:59.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:13:59.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:13:59.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:13:59.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:00.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:00.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:01.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:01.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:01.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:01.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:01.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:01.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:02.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:02.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:02.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:02.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:03.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:03.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:03.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:03.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:04.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:04.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:05.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:04.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:05.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:05.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:05.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:05.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:06.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:06.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:06.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:06.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:07.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:07.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:07.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:07.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:08.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:08.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:08.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:08.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:09.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:09.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:09.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:09.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:10.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:10.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:10.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:10.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:11.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:11.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:12.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:12.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:12.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:12.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:13.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:13.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:13.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:13.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:13.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:13.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:14.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:14.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:15.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:15.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:15.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:15.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:16.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:16.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:16.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:16.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:17.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:17.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:17.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:17.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:18.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:18.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:18.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:18.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:19.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:19.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:19.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:19.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:20.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:20.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:20.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:20.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:21.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:21.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:21.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:21.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:22.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:22.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:22.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:22.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:23.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:23.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:23.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:23.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:24.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:24.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:24.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:24.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:25.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:25.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:25.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:25.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:26.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:26.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:26.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:26.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:27.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:27.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:27.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:27.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:28.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:28.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:28.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:28.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:29.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:29.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:29.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:29.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:30.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:30.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:30.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:30.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:31.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:31.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:31.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:31.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:32.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:32.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:32.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:32.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:33.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:33.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:33.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:33.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:34.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:34.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:34.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:34.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:35.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:35.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:35.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:35.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:36.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:36.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:36.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:36.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:37.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:37.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:37.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:37.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:38.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:38.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:38.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:38.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:39.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:39.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:39.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:39.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:40.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:40.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:40.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:40.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:41.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:41.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:41.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:41.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:42.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:42.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:42.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:42.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:43.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:43.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:43.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:43.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:44.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:44.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:44.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:44.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:45.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:45.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:45.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:45.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:46.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:46.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:46.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:46.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:47.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:47.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:47.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:47.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:48.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:48.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:48.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:48.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:49.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:49.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:49.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:49.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:50.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:50.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:50.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:50.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:51.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:51.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:51.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:51.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:52.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:52.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:52.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:52.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:53.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:53.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:53.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:53.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:54.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:54.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:54.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:54.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:55.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:55.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:55.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:55.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:56.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:56.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:56.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:56.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:57.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:57.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:57.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:57.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:58.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:58.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:58.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:58.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:59.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:14:59.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:14:59.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:14:59.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:00.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:00.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:00.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:00.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:01.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:01.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:01.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:01.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:02.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:02.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:02.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:02.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:03.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:03.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:03.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:03.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:04.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:04.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:04.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:04.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:05.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:05.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:05.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:05.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:06.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:06.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:06.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:06.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:07.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:07.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:07.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:07.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:08.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:08.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:08.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:08.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:09.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:09.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:09.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:09.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:10.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:10.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:10.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:10.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:11.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:11.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:11.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:11.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:12.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:12.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:12.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:12.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:13.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:13.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:13.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:13.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:14.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:14.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:14.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:14.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:15.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:15.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:15.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:15.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:16.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:16.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:16.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:16.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:17.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:17.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:17.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:17.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:18.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:18.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:18.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:18.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:19.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:19.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:19.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:19.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:20.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:20.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:20.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:20.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:21.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:21.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:21.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:21.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:22.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:22.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:22.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:22.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:23.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:23.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:23.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:23.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:24.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:24.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:24.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:24.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:25.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:25.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:25.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:25.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:26.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:26.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:26.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:26.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:27.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:27.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:27.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:27.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:28.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:28.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:28.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:28.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:29.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:29.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:29.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:29.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:30.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:30.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:30.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:30.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:31.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:31.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:31.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:31.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:32.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:32.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:32.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:32.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:33.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:33.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:33.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:33.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:34.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:34.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:34.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:34.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:35.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:35.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:35.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:35.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:36.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:36.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:36.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:36.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:37.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:37.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:37.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:37.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:38.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:38.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:38.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:38.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:39.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:39.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:39.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:39.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:40.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:40.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:40.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:40.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:41.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:41.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:41.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:41.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:42.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:42.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:42.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:42.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:43.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:43.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:43.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:43.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:44.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:44.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:44.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:44.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:45.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:45.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:45.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:45.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:46.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:46.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:46.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:46.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:47.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:47.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:47.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:47.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:48.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:48.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:48.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:48.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:49.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:49.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:49.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:49.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:50.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:50.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:50.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:50.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:51.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:51.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:51.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:51.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:52.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:52.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:52.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:52.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:53.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:53.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:53.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:53.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:54.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:54.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:54.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:54.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:55.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:55.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:55.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:55.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:56.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:56.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:56.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:56.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:57.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:57.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:57.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:57.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:58.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:58.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:58.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:58.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:59.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:15:59.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:15:59.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:15:59.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:00.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:00.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:00.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:00.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:01.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:01.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:01.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:01.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:02.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:02.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:02.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:02.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:03.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:03.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:03.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:03.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:04.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:04.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:04.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:04.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:05.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:05.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:05.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:05.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:06.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:06.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:06.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:06.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:07.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:07.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:07.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:07.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:08.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:08.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:08.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:08.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:09.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:09.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:09.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:09.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:10.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:10.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:10.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:10.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:11.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:11.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:11.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:11.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:12.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:12.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:12.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:12.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:13.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:13.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:13.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:13.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:14.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:14.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:14.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:14.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:15.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:15.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:15.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:15.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:16.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:16.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:16.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:16.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:17.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:17.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:17.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:17.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:18.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:18.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:18.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:18.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:19.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:19.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:19.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:19.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:20.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:20.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:20.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:20.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:21.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:21.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:21.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:21.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:22.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:22.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:22.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:22.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:23.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:22.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:23.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:23.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:24.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:23.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:24.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:24.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:25.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:25.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:25.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:25.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:26.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:26.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:26.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:26.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:27.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:27.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:27.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:27.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:28.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:28.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:28.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:28.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:29.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:29.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:29.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:29.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:30.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:30.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:30.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:30.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:31.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:31.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:31.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:31.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:32.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:32.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:32.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:32.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:33.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:33.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:33.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:33.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:34.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:34.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:34.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:34.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:35.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:35.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:35.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:35.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:36.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:36.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:36.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:36.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:37.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:37.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:37.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:37.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:38.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:38.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:38.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:38.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:38.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:38.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:39.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:39.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:39.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:39.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:40.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:40.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:40.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:40.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:41.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:41.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:41.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:41.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:42.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:42.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:42.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:42.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:43.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:43.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:43.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:43.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:44.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:44.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:44.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:44.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:45.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:45.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:46.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:46.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:46.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:46.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:47.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:46.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:47.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:47.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:47.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:47.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:48.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:48.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:48.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:48.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:49.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:49.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:50.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:49.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:50.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:50.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:51.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:50.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:51.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:51.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:52.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:52.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:52.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:52.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:53.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:53.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:53.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:53.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:53.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:53.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:54.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:54.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:54.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:54.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:55.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:55.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:56.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:55.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:56.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:56.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:57.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:57.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:57.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:57.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:58.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:58.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:58.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:58.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:58.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:58.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:59.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:16:59.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:16:59.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:16:59.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:00.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:00.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:01.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:00.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:01.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:01.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:01.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:01.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:02.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:02.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:02.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:02.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:03.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:03.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:03.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:03.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:04.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:04.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:04.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:04.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:05.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:05.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:06.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:05.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:06.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:06.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:07.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:07.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:07.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:07.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:07.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:07.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:08.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:08.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:08.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:08.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:09.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:09.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:09.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:09.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:10.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:10.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:11.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:10.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:11.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:11.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:11.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:11.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:12.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:12.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:13.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:13.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:13.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:13.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:14.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:14.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:14.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:14.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:15.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:15.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:15.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:15.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:16.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:16.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:16.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:16.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:17.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:17.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:17.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:17.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:18.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:18.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:18.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:18.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:19.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:19.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:19.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:19.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:20.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:20.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:20.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:20.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:21.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:21.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:21.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:21.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:22.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:22.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:22.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:22.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:23.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:23.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:23.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:23.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:24.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:24.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:24.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:24.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:25.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:25.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:25.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:25.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:26.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:26.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:26.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:26.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:27.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:27.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:27.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:27.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:28.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:28.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:28.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:28.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:29.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:29.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:29.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:29.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:30.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:30.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:30.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:30.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:31.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:31.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:31.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:31.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:32.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:32.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:32.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:32.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:33.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:33.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:33.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:33.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:34.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:34.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:34.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:34.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:35.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:35.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:35.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:35.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:36.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:36.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:36.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:36.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:37.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:37.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:37.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:37.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:38.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:38.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:38.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:38.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:39.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:39.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:39.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:39.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:40.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:40.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:40.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:40.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:41.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:41.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:41.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:41.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:42.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:42.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:42.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:42.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:43.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:43.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:43.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:43.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:44.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:44.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:44.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:44.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:45.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:45.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:45.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:45.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:46.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:46.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:46.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:46.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:47.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:47.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:47.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:47.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:48.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:48.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:48.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:48.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:49.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:49.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:49.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:49.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:50.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:50.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:50.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:50.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:51.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:51.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:52.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:52.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:52.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:52.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:52.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:52.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:53.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:53.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:53.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:53.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:54.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:54.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:55.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:55.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:55.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:55.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:55.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:55.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:56.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:56.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:56.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:56.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:57.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:57.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:57.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:57.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:58.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:58.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:58.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:58.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:59.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:17:59.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:17:59.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:17:59.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:00.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:00.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:01.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:01.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:01.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:01.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:02.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:02.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:02.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:02.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:03.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:03.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:03.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:03.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:04.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:04.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:04.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:04.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:05.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:05.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:05.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:05.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:06.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:06.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:06.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:06.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:07.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:07.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:07.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:07.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:08.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:08.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:08.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:08.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:09.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:09.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:09.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:09.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:10.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:10.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:10.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:10.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:11.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:11.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:11.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:11.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:12.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:12.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:12.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:12.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:13.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:13.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:13.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:13.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:14.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:14.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:14.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:14.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:15.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:15.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:15.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:15.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:16.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:16.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:16.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:16.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:17.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:17.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:17.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:17.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:18.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:18.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:18.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:18.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:19.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:18.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:19.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:19.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:20.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:20.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:20.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:20.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:21.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:21.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:21.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:21.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:21.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:21.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:22.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:22.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:22.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:22.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:22.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:22.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:23.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:23.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:23.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:23.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:24.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:24.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:25.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:25.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:25.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:25.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:26.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:26.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:27.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:26.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:27.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:27.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:28.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:27.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:28.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:28.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:29.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:29.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:29.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:29.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:30.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:30.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:30.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:30.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:30.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:30.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:31.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:31.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:31.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:31.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:32.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:32.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:32.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:32.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:33.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:33.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:33.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:33.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:33.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:33.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:34.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:34.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:35.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:34.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:35.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:35.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:36.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:36.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:36.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:36.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:36.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:36.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:37.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:37.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:38.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:38.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:38.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:38.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:39.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:39.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:39.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:39.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:40.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:39.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:40.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:40.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:41.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:41.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:41.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:41.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:42.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:42.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:42.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:42.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:43.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:43.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:43.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:43.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:44.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:44.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:44.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:44.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:45.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:45.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:45.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:45.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:46.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:46.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:46.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:46.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:47.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:47.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:47.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:47.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:48.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:48.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:48.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:48.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:49.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:49.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:49.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:49.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:50.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:50.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:50.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:50.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:51.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:51.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:51.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:51.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:52.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:52.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:52.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:52.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:53.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:53.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:53.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:53.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:54.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:54.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:54.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:54.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:55.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:55.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:55.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:55.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:56.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:56.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:56.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:56.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:57.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:57.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:58.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:58.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:58.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:58.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:58.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:58.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:59.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:18:59.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:18:59.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:18:59.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:00.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:00.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:01.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:01.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:01.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:01.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:02.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:02.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:02.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:02.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:03.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:03.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:03.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:03.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:04.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:04.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:04.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:04.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:05.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:04.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:05.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:05.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:06.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:06.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:06.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:06.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:06.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:06.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:07.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:07.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:08.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:07.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:08.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:08.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:08.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:08.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:09.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:09.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:09.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:09.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:10.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:10.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:11.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:10.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:11.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:11.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:11.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:11.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:11.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:11.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:13.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:13.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:13.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:13.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:14.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:14.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:14.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:14.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:14.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:14.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:15.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:14.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:16.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:16.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:16.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:16.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:17.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:17.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:17.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:17.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:18.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:17.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:18.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:18.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:18.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:18.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:19.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:19.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:20.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:20.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:20.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:20.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:20.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:20.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:21.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:20.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:21.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:21.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:22.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:22.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:22.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:22.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:23.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:23.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:24.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:24.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:24.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:24.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:25.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:25.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:25.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:25.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:26.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:26.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:26.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:26.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:27.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:27.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:27.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:27.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:28.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:28.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:28.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:28.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:29.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:28.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:29.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:29.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:29.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:29.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:30.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:30.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:30.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:30.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:31.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:31.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:32.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:32.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:32.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:32.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:33.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:32.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:33.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:33.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:33.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:33.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:34.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:34.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:34.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:34.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:35.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:35.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:35.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:35.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:36.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:36.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:36.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:36.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:37.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:37.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:37.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:37.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:38.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:38.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:38.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:38.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:39.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:39.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:39.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:39.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:40.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:40.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:40.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:40.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:41.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:41.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:41.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:41.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:42.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:42.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:42.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:42.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:43.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:43.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:43.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:43.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:44.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:44.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:45.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:44.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:45.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:45.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:45.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:45.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:46.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:46.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:46.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:46.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:47.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:47.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:47.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:47.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:48.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:48.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:48.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:48.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:49.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:49.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:49.625 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T03:19:49.614+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x5561d64d88e0 msgr2=0x7f5fa403f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T03:19:50.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:49.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:50.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:50.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:50.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:50.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:51.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:51.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:51.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:51.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:52.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:52.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:52.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:52.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:53.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:53.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:53.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:53.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:54.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:54.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:55.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:55.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:55.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:55.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:56.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:56.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:56.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:56.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:56.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:56.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:57.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:57.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:57.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:57.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:58.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:58.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:58.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:58.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:59.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:19:59.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:19:59.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:19:59.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:00.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:00.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:01.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:01.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:01.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:01.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:02.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:02.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:02.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:02.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:03.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:03.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:03.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:03.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:04.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:04.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:04.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:04.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:04.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:04.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:05.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:05.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:06.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:06.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:06.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:06.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:07.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:07.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:07.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:07.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:08.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:08.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:08.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:08.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:09.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:09.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:09.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:09.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:10.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:10.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:10.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:10.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:11.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:11.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:11.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:11.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:12.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:12.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:12.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:12.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:13.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:13.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:13.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:13.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:14.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:14.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:14.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:14.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:15.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:15.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:15.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:15.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:16.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:16.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:16.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:16.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:17.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:17.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:17.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:17.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:18.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:18.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:18.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:18.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:19.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:19.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:19.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:19.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:20.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:20.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:20.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:20.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:21.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:21.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:21.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:21.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:22.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:22.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:22.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:22.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:23.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:23.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:23.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:23.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:24.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:24.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:24.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:24.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:25.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:25.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:25.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:25.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:26.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:26.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:26.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:26.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:27.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:27.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:27.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:27.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:28.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:28.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:28.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:28.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:29.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:29.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:29.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:29.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:30.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:30.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:30.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:30.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:31.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:31.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:31.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:31.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:32.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:32.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:32.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:32.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:33.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:33.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:33.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:33.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:34.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:34.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:34.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:34.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:35.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:35.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:35.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:35.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:36.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:36.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:36.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:36.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:37.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:37.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:37.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:37.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:38.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:38.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:38.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:38.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:39.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:39.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:39.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:39.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:40.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:40.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:40.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:40.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:41.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:41.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:41.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:41.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:42.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:42.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:42.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:42.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:43.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:43.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:43.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:43.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:44.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:44.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:44.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:44.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:45.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:45.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:45.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:45.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:46.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:46.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:46.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:46.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:47.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:47.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:47.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:47.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:48.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:48.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:48.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:48.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:49.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:49.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:49.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:49.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:50.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:50.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:50.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:50.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:51.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:51.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:51.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:51.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:52.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:52.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:52.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:52.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:53.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:53.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:53.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:53.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:54.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:54.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:54.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:54.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:55.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:55.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:55.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:55.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:56.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:56.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:56.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:56.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:57.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:57.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:57.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:57.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:58.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:58.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:58.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:58.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:59.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:20:59.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:20:59.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:20:59.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:00.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:00.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:00.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:00.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:01.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:01.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:01.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:01.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:02.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:02.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:02.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:02.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:03.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:03.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:03.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:03.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:04.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:04.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:04.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:04.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:05.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:05.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:05.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:05.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:06.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:06.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:06.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:06.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:07.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:07.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:07.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:07.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:08.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:08.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:08.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:08.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:09.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:09.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:09.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:09.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:10.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:10.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:10.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:10.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:11.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:11.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:11.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:11.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:12.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:12.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:12.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:12.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:13.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:13.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:13.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:13.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:14.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:14.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:14.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:14.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:15.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:15.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:15.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:15.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:16.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:16.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:16.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:16.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:17.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:17.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:17.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:17.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:18.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:18.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:18.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:18.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:19.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:19.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:19.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:19.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:20.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:20.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:20.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:20.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:21.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:21.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:21.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:21.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:22.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:22.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:22.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:22.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:23.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:23.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:23.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:23.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:24.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:24.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:24.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:24.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:25.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:25.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:25.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:25.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:26.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:26.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:26.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:26.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:27.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:27.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:27.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:27.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:28.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:28.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:28.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:28.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:29.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:29.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:29.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:29.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:30.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:30.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:30.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:30.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:31.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:31.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:31.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:31.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:32.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:32.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:32.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:32.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:33.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:33.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:33.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:33.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:34.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:34.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:34.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:34.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:35.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:35.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:35.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:35.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:36.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:36.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:36.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:36.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:37.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:37.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:37.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:37.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:38.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:38.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:38.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:38.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:39.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:39.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:39.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:39.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:40.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:40.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:40.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:40.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:41.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:41.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:41.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:41.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:42.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:42.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:42.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:42.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:43.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:43.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:43.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:43.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:44.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:44.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:44.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:44.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:45.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:45.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:45.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:45.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:46.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:46.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:46.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:46.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:47.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:47.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:47.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:47.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:48.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:48.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:48.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:48.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:49.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:49.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:49.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:49.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:50.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:50.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:50.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:50.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:51.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:51.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:51.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:51.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:52.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:52.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:52.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:52.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:53.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:53.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:53.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:53.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:54.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:54.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:54.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:54.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:55.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:55.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:55.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:55.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:56.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:56.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:56.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:56.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:57.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:57.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:57.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:57.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:58.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:58.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:58.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:58.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:59.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:21:59.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:21:59.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:21:59.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:00.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:00.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:00.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:00.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:01.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:01.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:01.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:01.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:02.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:02.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:02.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:02.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:03.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:03.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:03.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:03.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:04.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:04.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:04.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:04.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:05.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:05.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:05.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:05.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:06.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:06.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:06.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:06.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:07.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:07.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:07.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:07.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:08.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:08.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:08.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:08.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:09.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:09.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:09.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:09.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:10.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:10.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:10.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:10.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:11.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:11.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:11.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:11.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:12.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:12.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:12.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:12.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:13.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:13.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:13.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:13.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:14.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:14.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:14.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:14.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:15.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:15.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:15.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:15.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:16.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:16.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:16.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:16.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:17.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:17.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:17.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:17.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:18.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:18.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:18.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:18.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:19.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:19.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:19.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:19.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:20.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:20.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:20.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:20.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:21.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:21.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:21.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:21.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:22.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:22.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:22.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:22.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:23.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:23.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:23.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:23.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:24.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:24.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:24.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:24.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:25.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:25.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:25.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:25.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:26.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:26.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:26.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:26.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:27.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:27.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:27.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:27.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:28.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:28.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:28.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:28.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:29.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:29.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:29.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:29.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:30.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:30.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:30.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:30.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:31.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:31.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:31.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:31.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:32.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:32.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:32.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:32.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:33.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:33.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:33.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:33.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:34.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:34.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:34.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:34.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:35.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:35.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:35.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:35.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:36.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:36.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:36.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:36.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:37.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:37.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:37.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:37.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:38.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:38.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:38.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:38.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:39.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:39.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:39.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:39.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:40.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:40.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:40.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:40.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:41.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:41.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:41.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:41.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:42.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:42.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:42.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:42.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:43.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:43.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:43.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:43.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:44.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:44.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:44.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:44.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:45.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:45.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:45.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:45.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:46.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:46.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:46.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:46.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:47.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:47.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:47.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:47.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:48.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:48.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:48.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:48.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:49.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:49.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:49.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:49.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:50.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:50.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:50.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:50.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:51.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:51.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:51.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:51.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:52.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:52.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:52.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:52.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:53.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:53.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:53.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:53.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:54.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:54.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:54.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:54.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:55.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:55.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:55.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:55.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:56.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:56.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:56.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:56.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:57.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:57.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:57.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:57.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:58.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:58.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:58.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:58.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:59.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:22:59.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:22:59.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:22:59.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:00.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:00.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:00.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:00.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:01.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:01.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:01.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:01.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:02.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:02.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:02.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:02.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:03.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:03.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:03.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:03.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:04.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:04.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:04.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:04.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:05.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:05.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:05.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:05.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:06.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:06.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:06.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:06.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:07.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:07.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:07.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:07.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:08.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:08.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:08.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:08.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:09.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:09.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:09.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:09.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:10.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:10.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:10.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:10.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:11.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:11.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:11.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:11.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:12.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:12.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:12.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:12.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:13.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:13.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:13.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:13.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:14.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:14.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:14.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:14.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:15.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:15.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:15.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:15.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:16.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:16.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:16.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:16.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:17.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:17.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:17.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:17.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:18.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:18.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:18.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:18.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:19.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:19.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:19.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:19.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:20.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:20.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:20.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:20.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:21.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:21.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:21.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:21.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:22.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:22.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:22.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:22.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:23.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:23.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:23.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:23.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:24.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:24.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:24.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:24.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:25.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:25.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:25.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:25.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:26.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:26.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:26.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:26.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:27.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:27.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:27.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:27.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:28.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:28.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:28.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:28.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:29.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:29.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:29.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:29.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:30.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:30.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:30.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:30.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:31.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:31.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:31.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:31.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:32.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:32.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:32.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:32.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:33.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:33.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:33.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:33.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:34.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:34.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:34.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:34.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:35.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:35.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:35.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:35.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:36.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:36.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:36.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:36.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:37.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:37.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:37.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:37.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:38.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:38.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:38.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:38.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:39.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:39.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:40.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:40.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:40.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:40.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:41.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:41.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:41.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:41.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:42.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:42.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:42.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:42.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:43.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:43.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:43.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:43.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:44.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:44.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:44.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:44.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:45.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:45.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:45.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:45.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:46.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:46.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:46.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:46.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:47.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:47.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:47.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:47.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:48.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:48.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:48.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:48.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:48.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:48.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:49.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:49.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:49.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:49.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:50.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:50.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:50.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:50.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:51.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:51.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:51.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:51.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:52.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:52.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:52.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:52.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:53.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:53.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:53.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:53.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:54.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:54.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:54.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:54.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:55.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:55.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:55.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:55.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:56.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:56.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:56.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:56.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:57.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:57.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:57.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:57.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:58.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:58.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:58.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:58.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:59.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:23:59.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:23:59.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:23:59.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:00.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:00.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:00.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:00.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:01.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:01.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:01.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:01.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:02.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:02.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:02.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:02.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:03.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:03.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:03.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:03.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:04.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:04.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:04.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:04.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:05.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:05.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:05.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:05.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:06.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:06.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:06.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:06.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:07.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:07.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:07.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:07.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:08.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:08.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:08.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:08.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:09.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:09.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:09.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:09.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:10.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:10.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:10.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:10.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:11.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:11.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:11.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:11.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:12.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:12.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:12.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:12.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:13.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:13.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:13.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:13.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:14.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:14.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:14.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:14.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:15.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:15.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:15.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:15.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:16.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:16.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:16.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:16.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:17.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:17.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:17.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:17.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:18.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:18.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:18.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:18.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:19.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:19.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:19.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:19.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:20.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:20.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:20.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:20.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:21.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:21.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:21.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:21.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:22.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:22.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:22.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:22.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:23.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:23.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:23.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:23.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:24.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:24.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:24.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:24.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:25.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:25.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:25.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:25.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:26.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:26.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:26.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:26.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:27.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:27.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:27.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:27.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:28.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:28.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:28.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:28.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:29.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:29.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:29.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:29.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:30.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:30.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:30.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:30.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:31.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:31.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:31.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:31.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:32.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:32.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:32.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:32.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:33.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:33.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:33.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:33.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:34.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:34.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:34.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:34.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:35.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:35.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:35.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:35.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:36.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:36.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:36.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:36.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:37.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:37.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:37.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:37.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:38.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:38.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:38.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:38.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:39.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:39.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:39.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:39.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:40.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:40.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:40.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:40.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:41.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:41.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:41.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:41.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:42.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:42.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:42.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:42.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:43.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:43.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:43.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:43.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:44.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:44.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:44.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:44.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:45.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:45.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:45.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:45.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:46.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:46.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:46.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:46.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:47.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:47.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:47.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:47.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:48.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:48.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:48.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:48.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:49.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:49.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:49.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:49.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:50.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:50.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:50.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:50.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:51.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:51.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:51.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:51.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:52.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:52.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:52.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:52.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:53.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:53.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:53.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:53.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:54.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:54.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:54.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:54.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:55.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:55.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:55.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:55.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:56.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:56.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:56.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:56.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:57.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:57.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:57.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:57.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:58.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:58.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:58.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:58.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:59.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:24:59.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:24:59.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:24:59.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:00.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:00.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:00.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:00.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:01.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:01.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:01.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:01.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:02.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:02.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:02.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:02.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:03.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:03.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:03.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:03.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:04.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:04.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:04.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:04.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:05.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:05.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:05.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:05.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:06.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:06.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:06.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:06.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:07.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:07.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:07.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:07.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:08.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:08.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:08.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:08.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:09.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:09.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:09.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:09.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:10.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:10.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:10.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:10.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:11.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:11.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:11.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:11.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:12.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:12.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:12.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:12.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:13.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:13.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:13.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:13.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:14.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:14.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:14.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:14.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:15.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:15.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:15.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:15.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:16.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:16.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:16.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:16.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:17.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:17.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:17.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:17.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:18.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:18.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:18.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:18.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:19.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:19.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:19.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:19.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:20.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:20.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:20.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:20.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:21.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:21.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:21.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:21.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:22.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:22.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:22.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:22.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:23.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:23.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:23.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:23.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:24.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:24.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:24.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:24.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:25.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:25.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:25.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:25.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:26.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:26.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:26.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:26.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:27.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:27.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:27.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:27.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:28.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:28.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:28.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:28.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:29.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:29.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:29.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:29.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:30.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:30.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:30.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:30.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:31.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:31.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:31.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:31.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:32.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:32.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:32.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:32.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:33.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:33.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:33.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:33.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:34.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:34.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:34.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:34.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:35.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:35.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:35.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:35.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:36.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:36.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:36.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:36.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:37.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:37.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:37.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:37.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:38.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:38.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:38.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:38.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:39.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:39.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:39.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:39.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:40.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:40.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:40.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:40.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:41.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:41.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:41.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:41.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:42.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:42.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:42.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:42.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:43.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:43.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:43.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:43.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:44.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:44.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:44.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:44.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:45.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:45.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:45.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:45.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:46.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:46.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:46.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:46.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:47.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:47.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:47.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:47.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:48.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:48.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:48.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:48.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:49.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:49.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:49.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:49.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:50.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:50.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:50.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:50.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:51.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:51.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:51.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:51.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:52.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:52.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:52.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:52.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:53.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:53.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:53.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:53.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:54.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:54.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:54.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:54.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:55.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:55.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:55.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:55.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:56.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:56.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:56.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:56.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:57.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:57.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:57.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:57.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:58.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:58.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:58.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:58.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:59.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:25:59.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:25:59.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:25:59.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:00.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:00.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:00.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:00.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:01.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:01.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:01.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:01.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:02.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:02.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:02.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:02.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:03.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:03.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:03.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:03.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:04.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:04.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:04.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:04.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:05.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:05.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:05.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:05.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:06.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:06.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:06.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:06.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:07.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:07.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:07.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:07.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:08.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:08.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:08.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:08.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:09.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:09.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:09.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:09.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:10.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:10.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:10.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:10.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:11.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:11.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:11.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:11.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:12.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:12.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:12.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:12.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:13.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:13.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:13.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:13.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:14.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:14.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:14.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:14.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:15.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:15.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:15.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:15.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:16.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:16.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:16.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:16.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:17.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:17.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:18.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:17.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:18.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:18.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:18.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:18.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:19.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:19.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:19.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:19.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:20.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:20.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:21.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:21.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:21.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:21.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:22.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:22.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:22.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:22.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:23.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:23.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:23.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:23.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:24.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:24.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:24.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:24.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:25.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:25.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:25.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:25.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:26.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:26.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:26.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:26.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:27.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:27.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:27.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:27.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:28.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:28.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:28.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:28.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:29.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:29.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:29.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:29.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:30.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:30.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:30.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:30.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:31.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:31.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:31.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:31.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:32.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:32.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:32.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:32.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:33.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:33.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:33.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:33.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:34.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:34.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:34.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:34.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:35.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:35.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:35.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:35.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:36.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:36.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:36.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:36.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:37.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:37.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:37.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:37.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:38.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:38.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:38.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:38.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:39.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:39.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:39.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:39.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:40.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:40.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:40.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:40.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:40.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:40.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:41.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:41.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:42.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:42.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:42.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:42.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:43.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:42.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:43.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:43.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:44.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:43.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:44.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:44.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:45.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:45.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:45.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:45.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:46.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:46.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:46.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:46.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:47.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:47.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:47.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:47.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:48.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:48.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:48.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:48.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:49.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:49.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:49.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:49.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:49.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:49.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:50.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:50.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:50.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:50.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:51.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:51.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:52.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:52.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:52.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:52.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:53.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:53.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:53.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:53.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:54.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:54.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:54.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:54.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:55.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:55.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:55.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:55.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:56.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:56.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:56.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:56.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:57.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:57.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:57.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:57.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:58.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:58.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:58.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:58.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:59.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:26:59.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:26:59.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:26:59.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:00.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:00.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:00.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:00.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:01.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:01.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:01.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:01.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:02.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:02.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:02.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:02.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:03.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:03.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:03.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:03.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:04.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:04.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:04.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:04.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:05.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:05.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:05.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:05.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:06.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:06.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:06.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:06.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:07.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:07.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:07.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:07.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:08.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:08.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:08.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:08.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:09.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:09.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:09.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:09.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:10.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:10.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:10.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:10.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:11.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:11.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:11.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:11.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:12.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:12.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:12.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:12.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:13.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:13.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:13.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:13.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:14.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:14.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:14.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:14.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:15.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:15.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:15.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:15.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:16.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:16.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:16.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:16.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:17.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:17.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:17.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:17.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:18.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:18.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:18.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:18.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:19.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:19.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:19.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:19.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:20.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:20.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:20.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:20.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:21.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:21.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:21.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:21.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:22.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:22.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:22.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:22.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:23.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:23.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:23.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:23.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:24.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:24.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:24.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:24.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:25.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:25.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:25.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:25.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:26.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:26.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:26.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:26.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:27.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:27.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:27.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:27.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:28.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:28.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:28.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:28.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:29.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:29.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:29.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:29.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:30.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:30.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:30.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:30.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:31.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:31.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:31.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:31.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:32.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:32.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:32.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:32.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:33.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:33.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:33.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:33.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:34.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:34.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:34.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:34.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:35.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:35.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:35.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:35.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:36.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:36.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:36.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:36.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:37.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:37.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:37.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:37.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:38.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:38.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:38.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:38.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:39.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:39.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:39.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:39.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:40.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:40.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:40.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:40.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:41.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:41.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:41.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:41.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:42.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:42.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:42.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:42.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:43.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:43.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:43.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:43.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:44.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:44.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:44.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:44.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:45.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:45.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:45.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:45.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:46.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:46.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:46.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:46.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:47.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:47.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:47.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:47.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:48.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:48.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:48.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:48.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:49.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:49.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:49.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:49.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:50.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:50.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:50.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:50.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:51.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:51.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:51.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:51.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:52.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:52.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:52.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:52.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:53.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:53.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:53.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:53.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:54.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:54.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:54.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:54.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:55.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:54.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:55.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:55.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:55.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:55.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:56.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:56.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:56.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:56.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:57.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:57.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:57.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:57.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:58.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:58.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:58.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:58.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:59.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:27:59.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:27:59.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:27:59.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:00.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:00.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:00.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:00.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:01.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:01.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:01.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:01.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:02.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:02.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:03.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:03.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:03.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:03.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:04.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:04.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:04.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:04.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:05.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:05.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:05.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:05.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:06.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:06.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:06.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:06.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:07.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:07.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:07.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:07.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:08.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:08.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:08.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:08.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:09.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:09.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:09.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:09.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:10.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:10.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:10.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:10.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:11.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:11.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:12.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:12.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:12.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:12.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:13.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:13.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:13.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:13.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:14.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:14.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:14.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:14.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:15.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:15.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:15.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:15.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:16.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:16.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:16.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:16.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:17.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:17.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:17.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:17.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:18.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:18.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:18.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:18.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:19.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:19.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:19.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:19.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:20.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:20.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:20.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:20.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:21.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:21.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:21.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:21.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:22.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:22.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:22.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:22.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:23.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:23.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:23.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:23.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:24.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:24.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:24.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:24.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:25.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:25.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:25.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:25.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:26.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:26.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:26.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:26.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:27.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:27.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:27.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:27.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:28.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:28.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:28.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:28.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:29.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:29.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:29.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:29.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:30.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:30.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:30.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:30.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:31.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:31.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:31.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:31.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:32.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:32.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:32.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:32.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:32.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:32.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:33.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:33.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:33.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:33.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:34.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:34.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:34.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:34.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:35.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:35.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:35.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:35.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:36.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:36.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:36.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:36.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:37.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:37.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:37.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:37.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:38.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:38.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:38.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:38.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:39.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:39.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:39.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:39.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:40.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:40.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:40.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:40.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:41.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:41.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:42.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:42.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:42.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:42.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:43.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:43.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:43.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:43.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:44.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:43.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:44.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:44.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:45.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:44.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:45.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:45.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:46.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:46.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:46.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:46.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:47.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:47.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:47.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:47.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:48.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:48.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:48.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:48.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:48.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:48.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:49.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:49.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:49.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:49.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:50.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:50.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:50.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:50.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:51.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:51.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:51.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:51.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:52.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:52.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:52.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:52.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:53.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:53.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:53.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:54.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:54.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:54.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:54.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:55.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:55.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:55.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:55.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:56.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:56.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:56.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:56.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:57.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:57.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:57.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:57.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:58.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:58.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:58.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:58.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:59.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:28:59.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:28:59.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:28:59.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:00.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:00.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:00.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:00.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:01.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:01.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:01.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:01.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:02.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:02.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:02.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:02.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:03.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:03.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:03.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:03.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:04.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:04.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:04.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:04.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:05.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:05.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:05.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:05.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:06.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:06.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:06.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:06.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:07.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:07.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:07.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:07.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:08.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:08.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:08.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:08.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:09.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:09.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:09.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:09.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:10.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:10.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:10.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:10.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:11.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:11.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:11.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:11.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:12.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:12.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:12.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:12.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:13.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:13.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:13.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:13.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:14.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:14.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:15.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:15.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:15.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:15.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:16.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:16.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:16.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:16.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:17.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:17.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:17.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:17.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:18.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:18.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:18.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:18.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:18.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:18.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:19.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:19.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:19.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:19.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:20.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:20.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:20.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:20.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:21.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:21.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:21.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:21.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:22.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:22.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:22.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:22.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:23.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:23.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:23.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:23.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:24.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:24.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:24.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:24.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:25.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:25.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:25.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:25.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:26.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:26.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:26.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:26.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:27.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:27.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:27.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:27.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:28.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:28.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:28.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:28.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:29.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:29.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:29.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:29.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:30.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:30.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:30.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:30.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:31.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:31.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:31.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:31.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:32.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:32.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:32.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:32.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:33.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:33.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:33.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:33.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:34.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:34.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:34.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:34.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:35.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:35.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:36.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:36.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:36.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:36.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:36.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:36.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:37.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:37.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:38.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:37.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:38.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:38.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:39.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:39.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:39.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:39.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:40.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:40.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:40.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:40.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:41.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:41.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:41.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:41.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:42.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:42.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:42.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:42.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:43.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:43.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:43.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:43.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:44.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:44.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:44.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:44.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:45.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:45.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:45.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:45.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:46.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:46.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:46.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:46.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:47.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:47.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:47.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:47.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:48.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:48.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:48.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:48.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:49.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:49.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:49.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:49.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:50.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:50.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:50.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:50.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:51.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:51.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:51.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:51.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:52.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:52.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:52.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:52.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:53.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:53.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:53.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:53.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:54.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:54.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:54.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:54.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:55.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:55.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:55.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:55.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:56.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:56.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:56.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:56.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:57.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:57.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:57.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:57.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:58.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:58.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:58.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:58.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:59.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:29:59.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:29:59.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:29:59.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:00.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:00.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:00.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:00.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:01.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:01.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:01.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:01.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:02.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:02.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:02.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:02.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:03.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:03.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:03.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:03.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:04.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:04.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:04.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:04.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:05.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:05.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:05.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:05.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:06.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:06.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:06.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:06.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:07.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:07.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:07.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:07.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:08.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:08.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:08.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:08.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:09.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:09.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:09.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:09.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:10.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:10.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:10.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:10.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:11.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:11.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:11.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:11.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:12.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:12.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:12.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:12.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:13.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:13.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:13.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:13.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:14.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:14.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:14.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:14.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:15.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:15.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:15.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:15.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:16.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:16.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:16.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:16.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:17.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:17.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:17.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:17.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:18.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:18.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:18.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:18.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:19.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:19.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:19.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:19.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:20.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:20.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:20.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:20.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:21.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:21.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:21.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:21.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:22.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:22.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:22.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:22.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:23.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:23.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:23.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:23.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:24.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:24.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:24.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:24.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:25.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:25.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:25.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:25.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:26.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:26.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:26.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:26.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:27.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:27.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:27.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:27.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:28.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:28.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:28.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:28.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:29.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:29.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:29.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:29.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:30.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:30.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:30.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:30.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:31.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:31.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:31.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:31.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:32.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:32.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:32.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:32.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:33.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:33.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:33.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:33.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:34.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:34.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:34.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:34.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:35.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:35.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:35.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:35.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:36.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:36.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:36.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:36.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:37.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:37.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:37.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:37.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:38.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:38.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:38.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:38.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:39.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:39.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:39.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:39.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:40.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:40.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:40.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:40.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:41.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:41.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:41.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:41.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:42.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:42.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:42.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:42.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:43.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:43.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:43.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:43.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:44.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:44.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:44.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:44.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:45.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:45.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:45.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:45.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:46.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:46.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:46.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:46.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:47.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:47.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:47.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:47.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:48.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:48.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:48.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:48.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:49.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:49.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:49.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:49.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:50.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:50.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:50.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:50.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:51.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:51.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:51.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:51.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:52.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:52.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:52.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:52.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:53.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:53.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:53.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:53.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:54.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:54.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:54.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:54.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:55.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:55.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:55.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:55.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:56.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:56.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:56.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:56.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:57.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:57.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:57.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:57.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:58.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:58.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:58.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:58.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:59.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:30:59.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:30:59.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:30:59.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:00.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:00.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:00.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:00.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:01.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:01.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:01.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:01.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:02.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:02.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:02.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:02.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:03.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:03.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:03.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:03.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:04.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:04.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:04.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:04.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:05.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:05.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:05.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:05.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:06.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:06.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:06.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:06.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:07.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:07.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:07.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:07.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:08.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:08.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:08.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:08.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:09.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:09.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:09.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:09.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:10.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:10.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:10.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:10.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:11.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:11.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:11.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:11.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:12.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:12.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:12.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:12.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:13.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:13.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:13.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:13.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:14.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:14.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:14.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:14.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:15.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:15.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:15.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:15.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:16.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:16.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:16.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:16.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:17.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:17.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:17.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:17.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:18.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:18.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:18.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:18.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:19.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:19.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:19.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:19.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:20.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:20.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:20.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:20.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:21.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:21.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:21.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:21.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:22.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:22.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:22.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:22.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:23.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:23.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:23.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:23.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:24.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:24.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:24.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:24.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:25.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:25.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:25.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:25.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:26.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:26.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:26.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:26.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:27.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:27.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:27.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:27.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:28.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:28.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:28.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:28.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:29.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:29.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:29.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:29.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:30.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:30.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:30.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:30.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:31.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:31.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:31.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:31.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:32.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:32.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:32.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:32.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:33.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:33.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:33.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:33.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:34.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:34.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:34.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:34.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:35.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:35.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:35.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:35.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:36.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:36.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:36.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:36.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:37.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:37.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:37.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:37.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:38.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:38.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:38.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:38.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:39.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:39.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:39.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:39.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:40.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:40.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:40.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:40.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:41.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:41.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:41.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:41.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:42.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:42.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:42.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:42.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:43.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:43.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:43.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:43.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:44.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:44.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:44.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:44.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:45.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:45.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:45.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:45.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:46.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:46.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:46.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:46.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:47.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:47.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:47.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:47.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:48.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:48.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:48.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:48.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:49.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:49.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:49.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:49.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:50.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:50.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:50.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:50.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:51.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:51.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:51.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:51.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:52.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:52.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:52.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:52.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:53.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:53.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:53.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:53.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:54.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:54.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:54.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:54.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:55.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:55.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:55.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:55.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:56.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:56.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:56.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:56.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:57.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:57.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:57.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:57.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:58.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:58.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:58.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:58.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:59.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:31:59.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:31:59.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:31:59.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:00.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:00.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:00.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:00.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:01.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:01.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:01.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:01.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:02.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:02.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:02.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:02.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:03.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:03.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:03.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:03.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:04.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:04.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:04.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:04.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:05.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:05.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:05.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:05.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:06.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:06.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:06.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:06.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:07.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:07.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:07.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:07.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:08.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:08.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:08.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:08.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:09.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:09.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:09.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:09.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:10.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:10.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:10.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:10.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:11.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:11.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:11.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:11.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:12.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:12.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:12.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:12.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:13.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:13.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:13.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:13.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:14.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:14.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:14.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:14.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:15.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:15.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:15.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:15.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:16.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:16.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:16.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:16.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:17.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:17.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:17.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:17.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:18.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:18.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:18.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:18.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:19.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:19.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:19.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:19.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:20.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:20.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:20.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:20.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:21.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:21.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:21.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:21.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:22.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:22.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:22.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:22.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:23.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:23.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:23.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:23.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:24.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:24.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:24.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:24.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:25.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:25.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:25.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:25.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:26.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:26.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:26.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:26.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:27.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:27.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:27.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:27.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:28.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:28.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:28.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:28.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:29.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:29.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:29.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:29.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:30.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:30.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:30.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:30.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:31.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:31.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:31.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:31.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:32.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:32.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:32.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:32.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:33.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:33.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:33.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:33.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:34.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:34.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:34.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:34.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:35.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:35.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:35.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:35.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:36.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:36.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:36.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:36.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:37.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:37.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:37.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:37.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:38.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:38.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:38.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:38.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:39.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:39.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:39.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:39.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:40.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:40.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:40.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:40.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:41.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:41.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:41.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:41.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:42.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:42.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:42.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:42.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:43.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:43.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:43.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:43.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:44.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:44.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:44.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:44.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:45.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:45.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:45.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:45.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:46.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:46.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:46.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:46.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:47.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:47.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:47.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:47.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:48.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:48.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:48.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:48.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:49.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:49.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:50.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:50.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:50.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:50.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:51.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:50.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:51.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:51.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:51.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:51.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:52.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:52.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:53.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:53.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:53.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:53.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:54.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:54.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:54.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:54.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:55.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:55.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:55.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:55.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:56.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:56.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:56.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:56.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:57.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:56.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:57.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:57.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:58.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:58.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:58.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:58.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:59.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:32:59.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:32:59.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:32:59.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:00.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:00.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:00.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:00.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:01.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:01.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:01.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:01.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:02.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:02.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:02.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:02.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:03.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:03.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:03.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:03.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:04.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:04.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:04.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:04.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:05.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:05.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:05.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:05.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:06.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:06.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:06.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:06.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:07.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:07.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:07.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:07.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:08.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:08.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:08.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:08.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:09.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:09.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:09.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:09.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:10.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:10.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:10.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:10.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:11.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:11.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:11.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:11.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:12.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:12.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:12.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:12.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:13.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:13.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:13.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:13.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:14.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:14.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:14.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:14.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:15.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:15.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:15.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:15.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:16.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:16.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:16.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:16.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:17.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:17.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:17.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:17.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:18.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:18.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:18.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:18.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:19.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:19.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:19.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:19.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:20.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:20.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:20.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:20.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:21.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:21.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:21.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:21.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:22.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:22.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:22.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:22.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:23.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:23.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:23.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:23.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:24.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:24.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:24.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:24.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:25.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:25.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:25.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:25.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:26.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:26.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:26.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:26.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:27.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:27.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:27.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:27.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:28.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:28.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:28.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:28.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:29.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:29.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:29.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:29.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:30.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:30.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:30.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:30.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:31.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:31.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:31.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:31.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:32.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:32.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:32.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:32.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:33.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:33.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:33.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:33.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:34.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:34.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:34.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:34.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:35.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:35.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:35.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:35.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:36.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:36.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:36.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:36.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:37.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:37.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:37.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:37.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:38.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:38.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:38.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:38.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:39.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:39.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:39.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:39.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:40.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:40.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:40.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:40.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:41.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:41.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:41.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:41.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:42.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:42.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:42.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:42.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:43.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:43.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:43.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:43.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:44.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:44.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:44.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:44.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:45.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:45.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:45.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:45.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:46.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:46.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:46.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:46.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:47.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:47.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:47.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:47.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:48.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:48.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:48.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:48.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:49.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:49.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:49.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:49.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:50.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:50.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:50.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:50.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:51.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:51.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:51.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:51.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:52.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:52.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:52.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:52.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:53.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:53.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:53.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:53.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:54.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:54.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:54.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:54.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:55.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:55.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:55.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:55.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:56.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:56.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:56.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:56.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:57.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:57.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:57.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:57.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:58.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:58.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:58.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:58.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:59.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:33:59.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:33:59.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:33:59.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:00.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:00.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:00.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:00.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:01.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:01.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:01.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:01.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:02.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:02.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:02.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:02.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:03.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:03.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:03.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:03.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:04.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:04.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:04.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:04.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:05.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:05.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:05.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:05.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:06.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:06.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:06.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:06.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:07.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:07.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:07.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:07.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:08.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:08.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:08.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:08.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:09.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:09.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:09.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:09.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:10.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:10.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:10.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:10.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:11.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:11.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:11.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:11.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:12.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:12.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:12.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:12.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:13.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:13.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:13.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:13.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:14.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:14.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:14.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:14.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:15.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:15.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:15.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:15.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:16.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:16.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:16.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:16.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:17.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:17.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:17.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:17.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:18.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:18.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:18.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:18.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:19.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:19.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:19.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:19.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:20.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:20.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:20.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:20.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:21.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:21.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:21.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:21.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:22.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:22.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:22.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:22.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:23.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:23.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:23.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:23.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:24.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:24.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:24.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:24.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:25.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:25.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:25.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:25.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:26.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:26.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:26.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:26.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:27.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:27.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:27.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:27.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:28.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:28.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:28.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:28.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:29.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:29.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:29.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:29.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:30.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:30.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:30.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:30.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:31.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:31.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:31.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:31.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:32.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:32.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:32.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:32.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:33.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:33.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:33.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:33.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:34.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:34.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:34.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:34.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:35.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:35.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:35.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:35.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:36.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:36.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:36.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:36.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:37.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:37.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:37.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:37.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:38.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:38.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:38.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:38.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:39.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:39.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:39.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:39.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:40.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:40.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:40.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:40.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:41.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:41.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:41.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:41.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:42.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:42.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:42.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:42.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:43.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:42.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:43.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:43.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:43.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:43.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:44.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:44.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:44.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:44.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:45.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:45.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:45.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:45.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:46.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:46.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:46.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:46.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:47.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:47.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:47.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:47.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:48.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:48.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:48.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:48.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:49.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:49.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:49.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:49.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:50.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:50.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:50.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:50.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:51.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:51.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:51.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:51.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:52.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:52.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:52.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:52.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:53.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:53.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:53.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:53.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:54.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:54.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:54.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:54.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:55.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:55.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:55.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:55.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:56.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:56.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:56.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:56.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:57.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:57.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:57.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:57.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:58.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:58.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:58.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:34:58.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:34:59.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:34:59.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:00.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:00.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:00.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:00.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:01.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:01.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:01.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:01.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:02.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:02.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:02.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:02.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:03.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:03.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:03.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:03.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:04.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:04.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:04.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:04.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:05.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:05.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:05.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:05.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:06.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:06.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:06.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:06.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:07.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:07.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:07.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:07.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:08.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:08.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:08.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:08.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:09.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:09.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:09.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:09.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:10.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:10.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:10.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:10.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:11.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:11.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:11.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:11.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:12.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:12.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:12.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:12.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:13.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:13.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:13.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:13.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:14.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:14.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:14.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:14.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:15.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:15.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:15.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:15.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:16.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:16.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:16.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:16.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:16.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:16.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:17.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:17.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:18.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:18.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:18.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:18.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:19.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:19.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:19.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:19.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:20.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:20.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:20.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:20.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:21.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:21.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:21.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:21.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:22.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:22.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:22.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:22.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:23.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:22.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:23.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:23.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:23.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:23.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:24.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:24.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:25.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:25.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:25.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:25.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:26.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:26.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:26.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:26.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:27.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:27.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:27.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:27.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:28.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:28.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:28.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:28.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:29.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:29.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:29.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:29.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:30.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:30.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:30.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:30.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:31.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:31.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:31.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:31.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:32.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:32.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:32.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:32.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:33.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:33.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:33.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:33.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:34.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:34.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:34.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:34.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:35.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:35.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:35.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:35.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:36.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:36.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:36.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:36.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:37.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:37.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:37.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:37.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:38.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:38.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:38.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:38.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:39.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:39.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:39.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:39.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:40.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:40.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:40.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:40.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:41.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:41.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:41.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:41.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:42.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:42.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:42.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:42.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:43.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:43.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:43.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:43.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:44.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:44.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:44.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:44.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:45.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:45.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:45.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:45.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:46.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:46.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:46.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:46.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:47.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:47.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:47.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:47.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:48.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:48.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:48.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:48.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:49.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:49.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:49.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:49.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:50.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:50.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:50.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:50.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:51.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:51.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:51.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:51.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:52.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:52.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:52.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:52.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:53.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:53.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:53.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:53.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:54.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:54.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:54.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:54.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:55.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:55.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:55.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:55.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:56.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:56.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:56.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:56.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:57.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:57.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:57.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:57.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:58.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:58.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:58.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:58.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:59.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:35:59.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:35:59.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:35:59.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:00.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:00.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:00.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:00.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:01.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:01.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:01.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:01.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:02.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:02.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:02.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:02.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:03.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:03.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:03.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:03.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:04.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:04.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:04.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:04.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:05.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:05.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:05.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:05.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:06.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:06.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:06.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:06.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:07.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:07.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:07.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:07.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:08.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:08.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:08.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:08.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:09.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:09.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:09.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:09.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:10.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:10.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:10.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:10.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:11.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:11.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:11.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:11.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:12.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:12.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:12.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:12.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:13.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:13.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:13.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:13.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:14.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:14.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:14.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:14.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:15.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:15.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:15.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:15.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:16.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:16.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:16.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:16.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:17.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:17.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:17.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:17.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:18.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:18.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:18.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:18.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:19.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:19.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:19.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:19.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:20.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:20.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:20.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:20.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:21.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:21.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:21.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:21.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:22.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:22.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:22.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:22.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:23.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:23.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:23.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:23.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:24.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:24.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:24.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:24.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:25.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:25.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:25.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:25.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:26.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:26.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:26.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:26.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:27.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:27.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:27.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:27.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:28.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:28.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:28.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:28.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:29.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:29.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:29.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:29.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:30.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:30.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:30.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:30.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:31.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:31.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:31.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:31.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:32.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:32.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:32.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:32.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:33.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:33.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:33.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:33.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:34.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:34.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:34.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:34.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:35.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:35.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:35.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:35.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:36.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:36.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:36.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:36.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:37.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:37.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:37.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:37.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:38.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:38.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:38.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:38.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:39.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:39.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:39.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:39.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:40.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:40.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:40.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:40.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:41.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:41.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:41.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:41.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:42.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:42.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:42.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:42.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:43.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:43.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:43.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:43.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:44.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:44.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:44.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:44.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:45.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:45.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:45.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:45.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:46.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:46.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:46.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:46.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:47.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:47.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:47.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:47.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:48.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:48.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:48.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:48.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:49.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:49.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:49.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:49.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:50.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:50.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:50.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:50.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:51.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:51.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:51.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:51.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:52.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:52.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:52.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:52.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:53.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:53.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:53.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:53.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:54.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:54.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:54.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:54.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:55.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:55.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:55.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:55.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:56.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:56.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:56.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:56.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:57.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:57.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:57.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:57.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:58.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:58.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:58.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:58.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:59.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:36:59.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:36:59.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:36:59.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:00.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:00.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:00.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:00.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:01.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:01.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:01.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:01.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:02.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:02.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:02.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:02.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:03.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:03.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:03.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:03.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:04.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:04.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:04.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:04.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:05.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:05.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:05.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:05.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:06.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:06.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:06.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:06.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:07.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:07.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:07.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:07.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:08.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:08.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:08.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:08.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:09.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:09.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:09.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:09.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:10.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:10.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:10.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:10.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:11.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:11.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:11.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:11.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:12.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:12.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:12.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:12.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:13.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:13.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:13.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:13.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:14.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:14.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:14.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:14.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:15.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:15.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:15.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:15.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:16.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:16.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:16.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:16.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:17.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:17.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:17.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:17.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:18.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:18.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:18.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:18.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:19.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:19.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:19.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:19.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:20.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:20.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:20.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:20.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:21.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:21.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:21.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:21.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:22.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:22.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:22.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:22.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:23.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:23.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:23.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:23.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:24.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:24.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:24.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:24.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:25.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:25.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:25.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:25.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:26.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:26.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:26.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:26.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:27.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:27.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:27.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:27.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:28.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:28.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:28.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:28.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:29.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:29.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:29.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:29.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:30.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:30.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:30.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:30.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:31.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:31.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:31.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:31.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:32.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:32.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:32.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:32.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:33.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:33.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:33.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:33.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:34.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:34.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:34.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:34.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:35.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:35.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:35.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:35.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:36.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:36.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:36.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:36.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:37.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:37.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:37.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:37.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:38.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:38.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:38.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:38.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:39.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:39.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:39.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:39.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:40.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:40.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:40.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:40.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:41.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:41.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:41.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:41.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:42.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:42.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:42.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:42.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:43.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:43.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:43.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:43.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:44.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:44.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:44.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:44.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:45.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:45.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:45.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:45.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:46.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:46.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:46.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:46.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:47.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:47.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:47.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:47.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:48.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:48.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:48.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:48.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:49.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:49.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:49.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:49.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:50.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:50.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:50.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:50.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:51.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:51.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:51.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:51.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:52.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:52.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:52.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:52.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:53.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:53.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:53.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:53.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:54.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:54.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:54.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:54.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:55.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:55.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:55.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:55.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:56.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:56.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:56.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:56.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:57.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:57.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:57.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:57.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:58.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:58.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:58.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:58.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:59.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:37:59.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:37:59.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:37:59.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:00.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:00.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:00.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:00.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:01.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:01.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:01.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:01.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:02.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:02.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:02.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:02.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:03.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:03.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:03.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:03.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:04.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:04.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:04.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:04.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:05.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:05.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:05.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:05.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:06.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:06.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:06.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:06.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:07.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:07.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:07.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:07.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:08.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:08.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:08.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:08.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:09.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:09.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:09.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:09.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:10.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:10.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:10.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:10.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:11.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:11.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:11.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:11.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:12.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:12.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:12.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:12.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:13.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:13.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:13.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:13.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:14.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:14.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:14.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:14.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:15.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:15.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:15.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:15.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:16.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:16.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:16.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:16.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:17.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:17.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:17.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:17.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:18.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:18.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:18.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:18.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:19.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:19.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:19.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:19.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:20.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:20.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:20.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:20.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:21.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:21.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:21.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:21.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:22.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:22.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:22.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:22.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:23.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:23.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:23.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:23.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:24.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:24.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:24.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:24.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:25.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:25.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:25.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:25.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:26.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:26.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:26.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:26.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:27.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:27.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:27.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:27.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:28.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:28.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:28.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:28.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:29.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:29.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:29.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:29.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:30.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:30.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:30.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:30.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:31.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:31.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:31.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:31.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:32.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:32.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:32.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:32.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:33.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:33.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:33.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:33.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:34.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:34.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:34.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:34.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:35.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:35.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:35.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:35.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:36.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:36.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:36.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:36.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:37.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:37.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:37.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:37.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:38.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:38.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:38.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:38.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:39.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:39.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:39.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:39.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:40.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:40.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:40.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:40.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:41.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:41.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:41.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:41.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:42.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:42.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:42.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:42.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:43.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:43.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:43.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:43.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:44.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:44.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:44.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:44.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:45.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:45.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:45.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:45.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:46.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:46.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:46.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:46.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:47.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:47.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:47.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:47.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:48.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:48.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:48.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:48.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:49.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:49.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:49.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:49.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:50.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:50.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:50.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:50.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:51.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:51.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:51.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:51.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:52.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:52.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:52.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:52.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:53.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:53.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:53.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:53.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:54.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:54.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:54.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:54.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:55.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:55.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:55.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:55.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:56.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:56.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:56.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:56.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:57.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:57.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:57.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:57.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:58.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:58.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:58.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:58.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:59.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:38:59.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:38:59.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:38:59.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:00.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:00.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:00.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:00.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:01.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:01.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:01.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:01.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:02.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:02.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:02.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:02.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:03.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:03.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:03.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:03.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:04.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:04.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:04.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:04.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:05.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:05.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:05.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:05.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:06.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:06.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:06.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:06.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:07.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:07.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:07.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:07.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:08.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:08.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:08.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:08.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:09.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:09.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:09.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:09.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:10.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:10.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:10.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:10.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:11.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:11.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:11.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:11.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:12.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:12.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:12.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:12.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:13.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:13.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:13.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:13.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:14.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:14.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:14.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:14.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:15.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:15.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:15.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:15.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:16.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:16.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:16.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:16.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:17.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:17.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:17.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:17.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:18.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:18.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:18.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:18.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:19.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:19.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:19.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:19.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:20.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:20.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:20.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:20.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:21.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:21.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:22.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:22.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:22.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:22.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:22.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:22.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:23.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:23.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:23.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:23.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:24.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:24.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:25.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:25.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:25.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:25.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:26.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:25.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:26.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:26.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:27.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:26.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:27.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:27.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:28.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:28.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:28.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:28.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:29.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:28.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:29.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:29.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:29.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:29.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:30.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:30.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:31.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:30.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:31.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:31.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:31.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:31.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:32.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:32.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:32.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:32.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:33.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:33.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:33.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:33.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:34.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:34.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:35.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:35.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:35.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:35.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:36.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:36.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:36.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:36.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:37.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:37.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:37.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:37.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:38.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:38.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:38.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:38.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:39.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:39.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:39.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:39.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:40.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:40.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:40.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:40.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:41.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:41.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:41.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:41.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:42.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:42.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:42.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:42.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:43.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:43.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:43.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:43.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:44.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:44.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:44.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:44.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:45.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:45.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:45.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:45.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:46.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:46.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:46.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:46.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:47.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:47.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:47.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:47.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:48.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:48.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:48.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:48.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:49.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:49.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:49.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:49.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:50.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:50.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:50.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:50.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:51.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:51.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:51.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:51.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:52.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:52.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:52.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:52.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:53.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:53.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:53.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:53.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:54.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:54.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:54.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:54.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:55.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:55.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:55.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:55.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:56.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:56.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:56.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:56.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:57.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:57.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:57.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:57.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:58.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:58.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:58.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:58.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:59.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:39:59.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:39:59.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:39:59.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:00.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:00.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:00.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:00.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:01.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:01.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:01.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:01.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:02.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:02.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:02.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:02.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:03.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:03.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:03.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:03.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:04.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:04.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:04.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:04.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:05.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:05.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:05.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:05.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:06.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:06.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:06.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:06.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:07.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:07.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:07.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:07.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:08.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:08.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:08.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:08.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:09.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:09.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:09.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:09.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:10.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:10.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:10.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:10.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:11.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:11.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:11.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:11.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:12.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:12.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:12.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:12.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:13.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:13.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:13.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:13.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:14.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:14.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:14.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:14.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:15.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:15.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:15.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:15.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:16.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:16.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:16.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:16.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:17.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:17.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:17.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:17.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:18.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:18.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:18.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:18.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:19.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:19.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:19.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:19.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:20.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:20.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:20.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:20.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:21.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:21.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:21.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:21.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:22.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:22.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:22.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:22.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:23.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:23.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:23.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:23.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:24.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:24.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:24.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:24.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:25.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:25.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:25.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:25.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:26.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:26.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:26.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:26.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:27.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:27.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:27.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:27.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:28.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:28.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:28.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:28.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:29.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:29.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:29.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:29.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:30.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:30.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:30.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:30.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:31.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:31.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:31.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:31.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:32.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:32.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:32.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:32.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:33.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:33.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:33.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:33.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:34.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:34.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:34.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:34.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:35.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:35.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:35.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:35.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:36.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:36.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:36.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:36.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:37.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:37.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:37.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:37.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:38.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:38.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:38.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:38.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:39.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:39.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:39.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:39.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:40.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:40.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:40.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:40.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:41.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:41.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:41.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:41.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:42.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:42.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:42.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:42.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:43.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:43.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:43.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:43.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:44.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:44.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:44.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:44.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:45.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:45.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:45.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:45.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:46.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:46.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:46.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:46.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:46.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:46.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:47.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:47.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:47.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:47.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:48.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:48.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:48.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:48.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:49.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:49.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:49.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:49.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:50.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:50.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:50.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:50.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:51.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:51.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:51.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:51.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:52.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:52.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:52.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:52.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:53.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:53.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:53.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:53.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:54.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:54.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:54.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:54.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:55.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:55.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:55.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:55.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:56.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:56.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:56.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:56.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:57.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:57.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:57.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:57.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:58.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:58.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:58.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:58.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:59.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:40:59.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:40:59.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:40:59.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:00.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:00.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:00.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:00.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:01.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:01.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:01.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:01.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:02.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:02.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:02.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:02.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:03.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:03.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:03.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:03.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:04.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:04.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:04.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:04.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:05.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:05.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:05.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:05.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:06.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:06.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:06.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:06.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:07.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:07.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:07.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:07.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:08.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:08.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:08.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:08.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:09.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:09.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:09.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:09.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:10.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:10.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:10.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:10.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:11.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:11.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:11.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:11.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:12.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:12.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:12.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:12.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:13.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:13.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:13.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:13.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:14.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:14.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:14.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:14.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:15.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:15.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:15.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:15.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:16.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:16.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:16.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:16.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:17.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:17.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:18.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:17.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:18.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:18.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:18.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:18.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:19.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:19.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:20.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:19.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:20.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:20.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:20.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:20.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:21.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:21.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:21.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:21.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:22.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:22.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:22.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:22.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:23.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:23.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:23.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:23.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:24.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:24.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:24.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:24.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:25.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:25.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:26.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:25.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:26.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:26.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:26.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:26.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:27.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:27.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:28.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:27.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:28.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:28.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:28.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:28.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:29.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:29.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:29.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:29.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:30.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:30.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:30.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:30.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:31.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:31.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:32.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:31.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:32.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:32.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:33.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:33.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:33.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:33.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:34.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:34.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:34.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:34.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:34.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:34.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:35.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:35.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:35.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:35.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:36.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:36.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:36.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:36.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:37.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:37.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:37.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:37.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:38.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:38.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:38.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:38.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:39.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:39.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:39.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:39.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:40.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:40.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:40.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:40.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:41.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:41.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:41.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:41.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:42.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:42.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:42.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:42.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:43.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:43.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:43.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:43.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:44.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:44.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:44.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:44.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:45.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:45.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:45.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:45.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:46.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:46.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:46.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:46.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:47.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:47.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:47.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:47.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:48.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:48.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:48.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:48.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:49.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:49.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:49.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:49.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:50.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:50.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:50.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:50.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:51.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:51.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:51.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:51.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:52.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:52.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:52.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:52.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:53.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:53.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:53.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:53.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:54.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:54.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:54.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:54.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:55.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:55.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:55.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:55.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:56.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:56.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:56.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:56.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:57.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:57.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:57.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:57.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:58.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:58.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:58.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:58.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:59.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:41:59.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:41:59.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:41:59.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:00.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:00.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:00.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:00.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:01.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:01.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:01.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:01.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:02.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:02.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:02.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:02.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:03.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:03.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:03.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:03.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:04.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:04.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:04.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:04.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:05.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:05.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:05.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:05.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:06.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:06.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:06.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:06.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:07.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:07.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:07.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:07.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:08.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:08.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:08.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:08.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:09.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:09.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:09.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:09.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:10.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:10.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:10.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:10.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:11.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:11.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:11.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:11.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:12.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:12.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:12.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:12.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:13.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:13.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:13.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:13.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:14.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:14.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:14.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:14.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:15.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:15.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:15.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:15.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:16.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:16.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:16.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:16.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:17.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:17.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:17.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:17.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:18.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:18.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:18.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:18.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:19.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:19.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:19.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:19.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:20.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:20.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:20.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:20.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:21.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:21.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:21.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:21.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:22.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:22.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:22.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:22.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:23.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:23.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:23.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:23.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:24.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:24.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:24.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:24.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:25.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:25.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:25.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:25.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:26.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:26.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:26.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:26.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:27.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:27.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:27.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:27.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:28.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:28.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:28.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:28.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:29.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:29.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:29.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:29.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:30.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:30.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:30.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:30.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:31.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:31.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:31.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:31.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:32.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:32.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:32.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:32.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:33.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:33.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:33.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:33.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:34.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:34.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:34.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:34.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:35.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:35.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:35.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:35.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:36.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:36.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:36.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:36.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:37.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:37.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:37.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:37.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:38.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:38.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:38.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:38.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:39.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:39.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:39.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:39.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:40.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:40.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:40.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:40.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:41.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:41.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:41.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:41.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:42.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:42.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:42.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:42.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:43.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:43.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:43.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:43.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:44.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:44.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:44.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:44.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:45.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:45.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:45.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:45.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:46.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:46.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:46.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:46.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:47.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:47.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:47.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:47.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:48.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:48.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:48.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:48.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:49.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:49.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:49.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:49.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:50.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:50.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:50.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:50.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:51.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:51.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:51.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:51.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:52.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:52.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:52.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:52.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:53.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:53.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:53.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:53.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:54.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:54.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:54.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:54.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:55.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:55.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:55.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:55.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:56.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:56.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:56.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:56.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:57.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:57.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:57.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:57.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:58.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:58.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:58.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:58.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:59.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:42:59.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:42:59.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:42:59.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:00.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:00.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:00.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:00.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:01.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:01.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:01.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:01.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:02.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:02.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:02.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:02.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:03.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:03.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:03.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:03.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:04.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:04.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:04.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:04.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:05.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:05.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:05.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:05.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:06.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:06.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:06.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:06.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:07.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:07.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:07.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:07.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:08.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:08.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:08.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:08.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:09.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:09.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:09.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:09.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:10.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:10.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:10.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:10.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:11.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:11.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:11.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:11.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:12.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:12.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:12.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:12.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:13.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:13.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:13.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:13.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:14.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:14.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:14.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:14.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:15.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:15.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:15.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:15.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:16.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:16.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:16.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:16.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:17.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:17.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:17.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:17.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:18.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:18.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:18.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:18.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:19.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:19.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:19.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:19.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:20.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:20.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:20.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:20.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:21.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:21.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:21.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:21.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:22.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:22.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:22.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:22.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:23.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:23.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:23.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:23.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:24.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:24.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:24.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:24.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:25.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:25.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:25.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:25.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:26.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:26.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:26.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:26.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:27.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:27.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:27.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:27.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:28.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:28.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:28.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:28.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:29.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:29.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:29.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:29.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:30.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:30.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:30.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:30.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:31.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:31.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:32.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:32.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:32.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:32.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:32.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:32.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:33.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:33.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:34.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:34.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:34.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:34.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:34.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:34.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:35.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:35.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:36.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:36.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:36.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:36.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:37.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:37.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:37.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:37.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:38.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:38.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:38.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:38.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:38.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:38.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:39.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:39.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:39.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:39.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:40.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:40.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:40.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:40.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:41.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:41.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:41.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:41.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:42.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:42.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:42.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:42.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:43.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:43.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:44.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:44.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:44.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:44.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:45.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:45.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:45.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:45.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:46.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:46.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:46.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:46.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:47.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:47.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:47.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:47.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:48.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:48.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:48.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:48.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:49.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:49.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:49.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:49.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:50.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:50.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:50.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:50.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:51.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:51.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:51.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:51.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:52.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:52.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:52.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:52.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:53.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:53.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:53.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:53.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:54.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:54.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:54.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:54.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:55.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:55.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:55.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:55.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:56.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:56.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:56.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:56.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:57.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:57.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:57.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:57.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:58.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:58.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:58.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:58.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:59.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:43:59.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:43:59.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:43:59.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:00.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:00.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:00.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:00.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:01.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:01.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:01.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:01.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:02.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:02.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:02.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:02.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:03.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:02.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:03.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:03.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:03.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:03.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:04.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:04.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:04.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:04.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:05.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:05.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:05.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:05.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:06.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:06.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:07.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:07.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:07.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:07.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:08.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:08.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:08.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:08.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:09.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:09.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:09.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:09.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:10.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:10.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:10.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:10.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:11.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:11.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:11.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:11.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:12.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:12.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:12.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:12.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:13.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:13.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:13.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:13.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:14.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:14.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:14.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:14.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:15.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:15.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:15.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:15.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:16.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:16.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:16.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:16.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:17.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:17.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:17.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:17.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:18.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:18.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:18.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:18.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:19.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:19.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:19.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:19.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:20.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:20.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:20.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:20.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:21.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:21.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:21.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:21.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:22.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:22.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:22.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:22.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:23.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:23.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:23.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:23.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:24.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:24.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:24.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:24.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:25.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:25.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:25.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:25.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:26.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:26.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:26.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:26.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:27.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:27.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:27.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:27.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:28.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:28.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:28.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:28.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:29.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:29.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:29.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:29.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:30.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:30.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:30.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:30.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:31.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:31.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:31.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:31.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:32.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:32.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:32.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:32.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:33.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:33.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:33.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:33.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:34.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:34.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:34.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:34.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:35.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:35.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:35.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:35.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:36.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:36.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:36.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:36.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:37.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:37.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:37.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:37.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:38.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:38.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:38.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:38.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:39.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:39.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:39.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:39.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:40.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:40.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:40.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:40.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:41.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:41.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:41.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:41.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:42.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:42.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:42.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:42.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:43.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:43.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:43.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:43.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:44.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:44.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:44.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:44.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:45.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:45.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:45.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:45.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:46.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:46.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:46.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:46.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:47.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:47.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:47.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:47.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:48.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:48.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:48.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:48.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:49.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:49.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:49.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:49.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:50.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:50.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:50.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:50.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:51.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:51.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:51.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:51.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:52.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:52.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:52.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:52.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:53.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:53.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:53.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:53.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:54.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:54.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:54.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:54.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:55.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:55.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:55.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:55.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:56.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:56.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:56.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:56.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:57.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:57.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:57.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:57.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:58.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:58.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:58.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:58.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:59.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:44:59.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:44:59.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:44:59.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:00.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:00.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:00.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:00.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:01.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:01.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:01.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:01.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:02.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:02.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:02.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:02.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:03.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:03.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:03.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:03.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:04.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:04.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:04.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:04.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:05.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:05.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:05.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:05.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:06.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:06.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:06.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:06.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:07.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:07.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:07.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:07.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:08.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:08.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:08.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:08.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:09.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:09.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:09.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:09.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:10.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:10.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:10.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:10.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:11.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:11.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:11.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:11.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:12.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:12.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:12.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:12.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:13.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:13.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:13.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:14.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:14.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:14.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:14.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:15.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:15.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:15.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:15.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:16.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:16.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:16.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:16.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:17.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:17.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:17.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:17.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:18.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:18.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:18.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:18.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:19.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:19.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:19.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:19.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:20.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:20.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:20.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:20.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:21.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:21.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:21.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:21.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:22.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:22.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:22.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:22.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:23.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:23.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:23.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:23.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:24.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:24.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:24.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:24.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:25.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:25.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:25.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:25.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:26.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:26.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:26.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:26.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:27.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:27.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:27.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:27.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:28.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:28.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:28.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:28.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:29.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:29.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:29.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:29.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:30.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:30.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:30.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:30.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:31.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:31.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:31.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:31.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:32.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:32.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:32.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:32.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:33.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:33.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:33.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:33.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:34.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:34.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:34.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:34.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:35.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:35.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:35.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:35.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:36.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:36.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:36.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:36.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:37.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:37.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:37.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:37.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:38.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:38.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:38.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:38.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:39.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:39.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:39.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:39.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:40.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:40.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:40.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:40.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:41.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:41.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:41.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:41.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:42.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:42.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:42.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:42.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:43.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:43.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:43.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:43.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:44.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:44.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:44.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:44.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:45.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:45.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:45.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:45.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:46.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:46.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:46.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:46.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:47.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:47.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:47.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:47.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:48.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:48.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:48.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:48.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:49.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:49.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:49.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:49.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:50.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:50.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:50.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:50.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:51.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:51.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:51.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:51.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:52.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:52.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:52.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:52.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:53.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:53.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:53.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:53.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:54.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:54.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:54.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:54.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:55.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:55.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:55.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:55.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:56.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:56.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:56.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:56.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:57.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:57.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:57.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:57.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:58.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:58.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:58.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:58.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:59.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:59.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:45:59.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:45:59.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:00.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:45:59.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:00.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:00.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:01.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:00.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:01.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:01.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:02.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:02.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:02.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:02.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:03.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:03.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:03.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:03.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:04.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:04.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:04.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:04.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:05.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:05.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:05.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:05.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:06.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:06.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:06.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:06.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:07.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:07.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:07.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:07.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:08.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:08.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:08.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:08.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:09.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:09.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:09.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:09.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:10.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:10.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:10.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:10.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:11.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:11.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:11.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:11.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:12.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:12.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:12.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:12.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:13.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:13.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:13.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:13.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:14.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:14.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:14.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:14.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:15.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:15.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:15.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:15.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:16.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:16.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:16.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:16.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:17.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:17.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:17.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:17.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:18.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:18.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:18.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:18.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:19.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:19.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:19.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:19.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:20.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:20.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:20.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:20.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:21.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:21.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:21.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:21.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:22.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:22.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:22.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:22.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:23.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:23.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:23.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:23.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:24.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:24.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:24.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:24.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:25.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:25.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:25.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:25.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:26.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:26.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:26.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:26.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:27.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:27.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:27.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:27.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:28.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:28.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:28.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:28.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:29.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:29.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:29.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:29.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:30.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:30.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:30.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:30.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:31.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:31.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:31.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:31.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:32.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:32.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:32.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:32.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:33.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:33.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:33.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:33.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:34.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:34.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:34.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:34.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:35.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:35.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:35.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:35.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:36.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:36.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:36.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:36.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:37.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:37.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:37.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:37.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:38.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:38.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:38.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:38.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:39.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:39.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:39.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:39.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:40.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:40.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:40.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:40.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:41.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:41.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:41.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:41.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:42.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:42.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:42.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:42.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:43.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:43.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:43.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:43.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:44.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:44.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:44.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:44.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:45.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:45.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:45.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:45.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:46.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:46.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:46.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:46.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:47.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:47.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:47.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:47.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:48.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:48.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:48.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:48.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:49.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:49.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:49.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:49.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:50.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:50.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:50.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:50.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:51.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:51.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:51.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:51.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:52.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:52.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:52.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:52.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:53.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:53.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:53.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:53.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:54.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:54.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:54.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:54.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:55.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:55.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:55.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:55.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:56.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:56.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:56.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:56.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:57.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:57.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:57.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:57.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:58.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:58.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:58.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:58.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:59.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:46:59.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:46:59.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:46:59.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:00.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:00.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:00.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:00.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:01.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:01.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:01.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:01.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:02.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:02.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:02.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:02.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:03.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:03.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:03.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:03.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:04.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:04.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:04.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:04.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:05.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:05.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:05.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:05.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:06.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:06.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:06.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:06.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:07.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:07.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:07.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:07.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:08.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:08.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:08.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:08.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:09.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:09.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:09.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:09.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:10.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:10.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:10.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:10.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:11.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:11.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:11.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:11.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:12.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:12.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:12.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:12.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:13.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:13.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:13.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:13.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:14.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:14.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:14.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:14.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:15.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:15.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:15.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:15.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:16.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:16.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:16.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:16.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:17.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:17.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:17.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:17.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:18.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:18.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:18.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:18.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:19.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:19.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:19.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:19.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:20.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:20.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:20.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:20.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:21.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:21.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:21.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:21.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:22.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:22.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:22.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:22.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:23.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:23.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:23.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:23.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:24.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:24.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:24.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:24.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:25.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:25.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:25.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:25.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:26.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:26.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:26.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:26.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:27.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:27.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:27.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:27.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:28.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:28.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:28.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:28.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:29.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:29.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:29.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:29.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:30.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:30.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:30.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:30.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:31.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:31.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:31.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:31.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:32.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:32.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:32.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:32.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:33.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:33.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:33.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:33.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:34.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:34.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:34.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:34.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:35.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:35.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:35.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:35.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:36.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:36.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:36.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:36.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:37.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:37.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:37.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:37.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:38.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:38.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:38.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:38.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:39.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:39.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:39.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:39.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:40.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:40.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:40.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:40.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:41.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:41.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:41.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:41.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:42.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:42.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:42.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:42.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:43.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:43.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:43.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:43.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:44.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:44.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:44.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:44.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:45.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:45.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:45.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:45.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:46.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:46.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:46.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:46.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:47.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:47.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:47.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:47.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:48.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:48.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:48.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:48.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:49.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:49.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:49.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:49.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:50.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:50.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:50.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:50.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:51.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:51.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:51.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:51.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:52.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:52.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:52.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:52.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:53.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:53.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:53.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:53.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:54.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:54.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:54.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:54.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:55.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:55.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:55.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:55.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:56.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:56.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:56.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:56.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:57.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:57.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:57.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:57.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:58.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:58.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:58.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:58.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:59.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:47:59.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:47:59.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:47:59.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:00.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:00.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:00.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:00.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:01.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:01.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:01.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:01.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:02.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:02.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:02.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:02.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:03.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:03.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:03.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:03.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:04.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:04.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:04.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:04.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:05.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:05.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:05.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:05.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:06.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:06.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:06.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:06.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:07.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:07.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:07.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:07.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:08.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:08.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:08.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:08.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:09.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:09.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:09.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:09.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:10.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:10.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:10.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:10.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:11.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:11.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:11.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:11.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:12.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:12.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:12.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:12.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:13.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:13.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:13.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:13.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:14.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:14.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:14.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:14.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:15.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:15.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:15.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:15.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:16.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:16.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:16.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:16.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:17.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:17.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:17.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:17.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:18.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:18.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:18.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:18.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:19.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:19.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:19.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:19.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:20.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:20.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:20.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:20.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:21.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:21.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:21.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:21.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:22.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:22.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:22.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:22.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:23.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:23.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:23.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:23.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:24.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:24.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:24.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:24.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:25.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:25.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:25.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:25.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:26.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:26.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:26.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:26.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:27.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:27.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:27.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:27.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:28.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:28.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:28.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:28.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:29.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:29.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:29.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:29.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:30.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:30.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:30.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:30.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:31.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:31.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:31.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:31.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:32.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:32.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:32.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:32.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:33.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:33.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:33.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:33.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:34.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:34.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:34.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:34.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:35.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:35.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:35.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:35.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:36.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:36.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:36.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:36.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:37.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:37.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:37.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:37.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:38.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:38.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:38.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:38.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:39.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:39.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:39.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:39.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:40.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:40.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:40.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:40.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:41.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:41.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:41.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:41.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:42.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:42.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:42.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:42.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:43.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:43.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:43.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:43.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:44.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:44.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:44.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:44.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:45.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:45.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:45.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:45.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:46.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:46.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:46.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:46.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:47.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:47.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:47.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:47.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:48.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:48.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:48.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:48.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:49.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:49.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:49.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:49.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:50.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:50.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:50.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:50.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:51.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:51.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:51.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:51.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:52.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:52.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:52.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:52.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:53.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:53.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:53.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:53.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:54.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:54.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:54.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:54.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:55.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:55.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:55.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:55.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:56.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:56.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:56.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:56.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:57.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:57.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:57.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:57.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:58.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:58.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:58.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:58.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:59.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:48:59.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:48:59.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:48:59.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:00.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:00.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:00.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:00.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:01.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:01.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:01.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:01.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:02.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:02.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:02.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:02.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:03.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:03.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:03.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:03.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:04.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:04.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:04.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:04.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:05.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:05.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:05.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:05.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:06.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:06.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:06.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:06.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:07.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:07.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:07.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:07.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:08.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:08.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:08.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:08.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:09.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:09.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:09.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:09.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:10.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:10.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:10.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:10.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:11.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:11.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:11.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:11.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:12.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:12.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:12.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:12.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:13.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:13.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:13.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:13.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:14.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:14.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:14.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:14.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:15.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:15.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:15.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:15.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:16.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:16.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:16.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:16.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:17.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:17.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:17.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:17.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:18.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:18.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:18.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:18.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:19.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:19.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:19.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:19.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:20.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:20.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:20.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:20.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:21.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:21.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:21.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:21.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:22.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:22.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:22.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:22.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:23.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:23.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:23.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:23.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:24.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:24.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:24.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:24.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:25.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:25.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:25.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:25.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:26.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:26.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:26.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:26.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:27.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:27.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:27.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:27.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:28.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:28.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:28.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:28.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:29.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:29.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:29.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:29.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:30.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:30.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:30.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:30.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:31.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:31.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:31.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:31.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:32.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:32.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:32.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:33.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:33.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:33.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:33.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:34.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:34.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:34.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:34.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:35.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:35.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:36.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:36.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:36.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:36.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:37.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:37.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:37.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:37.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:38.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:37.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:38.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:38.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:39.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:39.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:39.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:39.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:40.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:40.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:40.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:40.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:41.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:41.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:41.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:41.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:42.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:42.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:42.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:42.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:42.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:42.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:43.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:43.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:43.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:43.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:44.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:44.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:44.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:44.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:45.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:45.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:45.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:45.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:46.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:46.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:46.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:46.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:47.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:47.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:47.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:47.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:48.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:48.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:48.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:48.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:50.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:49.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:50.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:50.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:51.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:50.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:51.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:51.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:52.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:52.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:52.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:52.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:53.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:53.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:53.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:53.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:53.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:53.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:54.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:54.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:54.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:54.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:55.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:55.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:55.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:55.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:56.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:56.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:56.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:56.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:57.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:57.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:57.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:57.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:58.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:58.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:58.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:58.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:59.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:49:59.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:49:59.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:49:59.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:00.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:00.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:00.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:00.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:01.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:01.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:01.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:01.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:02.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:02.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:02.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:02.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:03.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:03.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:03.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:03.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:04.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:04.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:04.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:04.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:05.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:05.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:05.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:05.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:06.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:06.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:06.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:06.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:07.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:07.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:07.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:07.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:08.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:08.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:08.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:08.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:09.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:09.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:09.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:09.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:10.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:10.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:10.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:10.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:11.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:11.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:11.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:11.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:12.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:12.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:12.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:12.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:13.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:13.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:13.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:13.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:14.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:14.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:14.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:14.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:15.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:15.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:15.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:15.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:16.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:16.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:16.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:16.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:17.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:17.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:17.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:17.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:18.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:18.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:18.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:18.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:19.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:19.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:19.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:19.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:20.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:20.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:20.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:20.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:21.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:21.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:21.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:21.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:22.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:22.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:22.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:22.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:23.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:23.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:23.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:23.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:24.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:24.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:24.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:24.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:25.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:25.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:25.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:25.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:26.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:26.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:26.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:26.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:27.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:27.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:27.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:27.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:28.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:28.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:28.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:28.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:29.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:29.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:29.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:29.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:30.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:30.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:30.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:30.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:31.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:31.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:31.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:31.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:32.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:32.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:32.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:32.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:33.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:33.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:33.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:33.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:34.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:34.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:34.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:34.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:35.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:35.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:35.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:35.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:36.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:36.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:36.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:36.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:37.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:37.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:37.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:37.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:38.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:38.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:38.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:38.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:39.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:39.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:39.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:39.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:40.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:40.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:40.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:40.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:41.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:41.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:41.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:41.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:42.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:42.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:42.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:42.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:43.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:43.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:43.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:43.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:44.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:44.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:44.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:44.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:45.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:45.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:45.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:45.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:46.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:46.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:46.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:46.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:47.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:47.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:47.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:47.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:48.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:48.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:48.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:48.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:49.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:49.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:49.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:49.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:50.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:50.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:50.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:50.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:51.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:51.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:51.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:51.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:52.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:52.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:52.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:52.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:53.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:53.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:53.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:53.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:54.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:54.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:54.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:54.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:55.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:55.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:55.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:55.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:56.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:56.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:56.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:56.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:57.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:57.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:57.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:57.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:58.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:58.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:58.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:58.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:50:59.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:50:59.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:00.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:50:59.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:00.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:00.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:01.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:01.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:01.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:01.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:01.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:01.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:02.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:02.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:03.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:02.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:03.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:03.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:04.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:04.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:04.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:04.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:05.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:04.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:05.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:05.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:06.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:06.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:06.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:06.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:06.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:06.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:07.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:07.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:07.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:07.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:08.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:08.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:08.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:08.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:09.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:09.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:09.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:09.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:10.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:10.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:10.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:10.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:11.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:11.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:11.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:11.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:12.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:12.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:12.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:12.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:13.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:13.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:13.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:13.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:14.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:14.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:14.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:14.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:15.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:15.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:15.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:15.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:16.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:16.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:16.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:16.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:17.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:17.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:17.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:17.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:18.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:18.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:18.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:18.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:19.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:19.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:19.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:19.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:20.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:20.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:20.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:20.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:21.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:21.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:21.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:21.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:22.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:22.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:22.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:22.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:23.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:23.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:23.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:23.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:24.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:24.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:24.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:24.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:25.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:25.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:25.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:25.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:26.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:26.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:26.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:26.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:27.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:27.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:27.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:27.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:28.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:28.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:28.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:28.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:29.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:29.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:29.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:29.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:30.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:30.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:30.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:30.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:31.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:31.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:31.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:31.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:32.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:32.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:32.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:32.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:33.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:33.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:33.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:33.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:34.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:34.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:34.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:34.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:35.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:35.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:35.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:35.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:36.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:36.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:36.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:36.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:37.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:37.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:37.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:37.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:38.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:38.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:38.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:38.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:39.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:39.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:39.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:39.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:40.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:40.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:40.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:40.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:41.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:41.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:41.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:41.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:42.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:42.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:42.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:42.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:43.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:43.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:43.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:43.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:44.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:44.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:44.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:44.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:45.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:45.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:45.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:45.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:46.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:46.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:46.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:46.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:47.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:47.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:47.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:47.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:48.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:48.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:48.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:48.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:49.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:49.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:49.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:49.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:50.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:50.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:50.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:50.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:51.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:51.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:51.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:51.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:52.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:52.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:52.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:52.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:53.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:53.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:53.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:53.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:54.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:54.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:54.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:54.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:55.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:55.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:55.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:55.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:56.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:56.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:57.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:57.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:57.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:57.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:58.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:58.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:58.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:58.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:59.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:59.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:51:59.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:51:59.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:00.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:51:59.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:00.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:00.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:00.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:00.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:01.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:01.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:01.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:01.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:02.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:02.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:02.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:02.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:03.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:03.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:03.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:03.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:04.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:04.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:05.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:05.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:05.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:05.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:06.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:06.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:06.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:06.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:06.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:06.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:07.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:07.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:08.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:08.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:08.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:08.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:09.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:09.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:09.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:09.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:10.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:10.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:10.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:10.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:11.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:11.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:11.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:11.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:12.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:12.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:12.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:12.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:12.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:12.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:13.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:13.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:14.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:14.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:14.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:14.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:15.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:15.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:15.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:15.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:15.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:15.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:16.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:16.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:17.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:17.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:17.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:17.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:18.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:18.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:18.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:18.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:19.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:19.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:19.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:19.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:20.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:20.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:20.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:20.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:21.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:21.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:21.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:21.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:22.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:22.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:22.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:22.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:23.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:23.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:23.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:23.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:24.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:24.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:24.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:24.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:25.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:25.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:25.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:25.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:26.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:26.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:26.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:26.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:27.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:27.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:27.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:27.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:28.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:28.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:28.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:28.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:29.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:29.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:29.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:29.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:30.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:30.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:30.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:30.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:31.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:31.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:31.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:31.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:32.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:32.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:32.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:32.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:33.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:33.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:33.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:33.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:34.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:34.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:34.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:34.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:35.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:35.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:35.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:35.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:36.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:36.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:36.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:36.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:37.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:37.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:37.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:37.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:38.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:38.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:38.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:38.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:39.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:39.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:39.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:39.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:40.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:40.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:40.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:40.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:41.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:41.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:41.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:41.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:42.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:42.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:42.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:42.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:43.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:43.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:43.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:43.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:44.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:44.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:44.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:44.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:45.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:45.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:45.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:45.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:46.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:46.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:46.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:46.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:47.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:47.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:47.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:47.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:48.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:48.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:48.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:48.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:49.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:49.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:49.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:49.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:50.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:50.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:50.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:50.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:51.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:51.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:51.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:51.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:52.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:52.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:52.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:52.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:53.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:53.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:53.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:53.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:54.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:54.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:54.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:54.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:55.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:55.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:55.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:55.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:56.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:56.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:56.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:56.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:57.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:57.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:57.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:57.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:58.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:58.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:58.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:58.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:59.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:52:59.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:52:59.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:52:59.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:00.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:00.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:00.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:00.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:01.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:01.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:01.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:01.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:02.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:02.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:02.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:02.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:03.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:03.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:03.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:03.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:04.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:04.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:04.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:04.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:05.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:05.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:05.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:05.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:06.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:06.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:06.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:06.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:07.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:07.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:07.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:07.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:08.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:08.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:08.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:08.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:09.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:09.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:09.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:09.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:10.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:10.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:10.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:10.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:11.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:11.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:11.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:11.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:12.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:12.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:12.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:12.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:13.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:13.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:13.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:13.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:14.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:14.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:14.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:14.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:15.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:15.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:15.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:15.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:16.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:16.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:16.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:16.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:17.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:17.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:17.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:17.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:18.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:18.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:18.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:18.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:19.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:19.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:19.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:19.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:20.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:20.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:20.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:20.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:21.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:21.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:21.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:21.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:22.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:22.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:22.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:22.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:23.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:23.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:23.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:23.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:24.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:24.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:24.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:24.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:25.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:25.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:25.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:25.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:26.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:26.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:26.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:26.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:27.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:27.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:27.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:27.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:28.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:28.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:28.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:28.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:29.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:29.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:29.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:29.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:30.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:30.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:30.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:30.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:31.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:31.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:31.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:31.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:32.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:32.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:32.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:32.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:33.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:33.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:33.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:33.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:34.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:34.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:34.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:34.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:35.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:35.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:35.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:35.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:36.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:36.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:36.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:36.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:37.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:37.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:37.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:37.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:38.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:38.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:38.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:38.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:39.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:39.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:39.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:39.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:40.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:40.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:40.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:40.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:41.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:41.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:41.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:41.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:42.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:42.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:42.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:42.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:43.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:43.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:43.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:43.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:44.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:44.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:44.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:44.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:45.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:45.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:45.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:45.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:46.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:46.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:46.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:46.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:47.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:47.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:47.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:47.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:48.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:48.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:48.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:48.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:49.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:49.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:49.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:49.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:50.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:50.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:50.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:50.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:51.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:51.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:51.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:51.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:52.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:52.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:52.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:52.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:53.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:53.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:53.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:53.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:54.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:54.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:54.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:54.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:55.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:55.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:55.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:55.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:56.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:56.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:56.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:56.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:57.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:57.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:57.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:57.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:58.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:58.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:58.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:58.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:59.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:53:59.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:53:59.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:53:59.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:00.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:00.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:00.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:00.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:01.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:01.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:01.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:01.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:02.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:02.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:02.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:02.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:03.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:03.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:03.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:03.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:04.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:04.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:04.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:04.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:05.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:05.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:05.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:05.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:06.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:06.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:06.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:06.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:07.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:07.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:07.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:07.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:08.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:08.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:08.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:08.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:09.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:09.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:09.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:09.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:10.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:10.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:10.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:10.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:11.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:11.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:11.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:11.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:12.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:12.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:12.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:12.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:13.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:13.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:13.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:13.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:14.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:14.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:14.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:14.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:15.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:15.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:15.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:15.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:16.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:16.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:16.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:16.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:17.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:17.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:17.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:17.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:18.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:18.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:18.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:18.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:19.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:19.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:19.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:19.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:20.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:19.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:20.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:20.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:21.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:21.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:21.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:21.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:22.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:22.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:22.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:22.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:23.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:23.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:23.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:23.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:24.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:24.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:24.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:24.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:25.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:25.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:25.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:25.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:26.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:26.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:26.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:26.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:27.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:27.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:27.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:27.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:28.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:28.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:28.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:28.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:29.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:29.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:29.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:29.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:30.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:30.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:30.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:30.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:31.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:31.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:31.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:31.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:31.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:31.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:32.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:32.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:33.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:33.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:33.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:33.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:33.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:33.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:34.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:34.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:34.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:34.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:35.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:35.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:35.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:35.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:36.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:36.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:36.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:36.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:37.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:37.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:37.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:37.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:38.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:38.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:38.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:38.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:39.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:39.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:39.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:39.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:40.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:40.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:41.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:40.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:41.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:41.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:42.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:42.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:42.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:42.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:43.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:43.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:43.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:43.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:44.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:44.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:44.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:44.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:45.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:45.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:45.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:45.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:46.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:46.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:46.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:46.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:47.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:47.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:47.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:47.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:48.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:48.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:48.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:48.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:49.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:49.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:49.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:49.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:50.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:50.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:50.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:50.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:51.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:51.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:51.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:51.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:52.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:52.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:52.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:52.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:53.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:53.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:53.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:53.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:54.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:54.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:54.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:54.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:55.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:55.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:55.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:55.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:56.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:56.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:56.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:56.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:57.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:57.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:57.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:57.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:58.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:58.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:58.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:58.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:59.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:54:59.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:54:59.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:54:59.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:00.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:00.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:00.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:00.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:01.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:01.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:01.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:01.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:02.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:02.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:02.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:02.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:03.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:03.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:03.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:03.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:04.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:04.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:04.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:04.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:05.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:04.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:05.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:05.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:06.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:06.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:06.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:06.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:07.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:07.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:07.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:07.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:08.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:08.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:08.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:08.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:08.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:08.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:09.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:09.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:09.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:09.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:10.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:10.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:10.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:10.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:11.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:11.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:11.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:11.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:12.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:12.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:13.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:13.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:13.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:13.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:14.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:14.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:14.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:14.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:15.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:15.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:15.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:15.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:15.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:15.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:16.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:16.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:17.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:17.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:17.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:17.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:18.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:18.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:18.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:18.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:19.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:18.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:19.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:19.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:20.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:20.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:20.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:20.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:21.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:21.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:21.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:21.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:22.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:22.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:22.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:22.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:23.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:23.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:23.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:23.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:24.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:24.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:24.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:24.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:25.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:25.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:25.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:25.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:26.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:26.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:26.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:26.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:27.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:27.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:27.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:27.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:28.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:28.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:28.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:28.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:29.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:29.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:29.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:29.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:30.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:30.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:30.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:30.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:31.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:31.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:31.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:31.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:32.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:32.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:32.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:32.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:33.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:33.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:33.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:33.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:34.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:34.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:34.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:34.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:35.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:35.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:35.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:35.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:36.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:36.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:36.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:36.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:37.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:37.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:37.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:37.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:38.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:38.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:38.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:38.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:39.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:39.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:39.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:39.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:40.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:40.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:40.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:40.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:41.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:41.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:41.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:41.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:42.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:42.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:42.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:42.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:43.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:43.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:43.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:43.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:44.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:44.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:44.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:44.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:45.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:45.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:45.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:45.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:46.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:46.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:46.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:46.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:47.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:47.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:47.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:47.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:48.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:48.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:48.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:48.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:49.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:49.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:49.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:49.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:50.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:50.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:50.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:50.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:51.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:51.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:51.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:51.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:52.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:52.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:52.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:52.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:53.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:53.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:53.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:54.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:54.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:54.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:54.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:55.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:55.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:55.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:55.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:56.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:56.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:56.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:56.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:57.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:57.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:57.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:57.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:58.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:58.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:58.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:58.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:59.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:55:59.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:55:59.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:55:59.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:00.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:00.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:00.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:00.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:01.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:01.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:01.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:01.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:02.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:02.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:02.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:02.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:03.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:03.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:03.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:03.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:04.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:04.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:05.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:05.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:05.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:05.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:06.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:06.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:06.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:06.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:07.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:07.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:07.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:07.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:07.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:07.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:08.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:08.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:08.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:08.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:09.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:09.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:09.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:09.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:10.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:10.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:10.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:10.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:11.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:11.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:11.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:11.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:12.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:12.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:12.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:12.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:13.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:13.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:13.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:13.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:14.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:14.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:14.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:14.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:15.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:15.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:15.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:15.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:16.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:16.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:16.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:16.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:17.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:17.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:18.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:18.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:18.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:18.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:19.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:19.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:19.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:19.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:20.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:20.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:20.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:20.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:21.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:21.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:21.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:21.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:22.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:22.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:22.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:22.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:23.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:23.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:23.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:23.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:24.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:24.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:24.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:24.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:25.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:25.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:25.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:25.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:26.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:26.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:26.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:26.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:27.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:27.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:27.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:27.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:28.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:28.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:28.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:28.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:29.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:29.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:29.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:29.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:30.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:30.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:30.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:30.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:31.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:31.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:31.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:31.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:32.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:32.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:32.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:32.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:33.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:33.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:33.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:33.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:34.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:34.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:34.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:34.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:35.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:35.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:35.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:35.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:36.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:36.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:36.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:36.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:37.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:37.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:37.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:37.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:38.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:38.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:38.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:38.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:39.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:39.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:39.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:39.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:40.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:40.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:40.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:40.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:41.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:41.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:41.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:41.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:41.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:41.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:42.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:42.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:42.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:42.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:43.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:43.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:43.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:43.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:44.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:44.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:44.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:44.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:45.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:45.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:45.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:45.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:46.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:46.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:46.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:46.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:47.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:47.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:47.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:47.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:48.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:48.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:48.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:48.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:49.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:49.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:49.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:49.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:50.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:50.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:50.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:50.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:51.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:51.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:51.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:51.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:52.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:52.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:52.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:52.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:53.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:53.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:53.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:53.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:54.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:54.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:54.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:54.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:55.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:55.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:55.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:55.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:56.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:56.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:56.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:56.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:57.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:57.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:57.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:57.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:58.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:58.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:58.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:58.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:59.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:56:59.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:56:59.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:56:59.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:00.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:00.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:00.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:00.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:01.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:01.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:01.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:01.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:02.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:02.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:02.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:02.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:03.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:03.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:03.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:03.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:04.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:04.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:04.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:04.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:05.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:05.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:05.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:05.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:06.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:06.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:06.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:06.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:07.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:07.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:07.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:07.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:08.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:08.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:08.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:08.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:09.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:09.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:09.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:09.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:10.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:10.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:10.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:10.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:11.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:11.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:11.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:11.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:12.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:12.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:12.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:12.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:13.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:13.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:13.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:13.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:14.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:14.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:14.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:14.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:15.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:15.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:15.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:15.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:16.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:16.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:16.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:16.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:17.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:17.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:17.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:17.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:18.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:18.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:18.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:18.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:19.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:19.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:19.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:19.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:20.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:20.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:20.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:20.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:21.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:21.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:21.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:21.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:22.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:22.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:22.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:22.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:23.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:23.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:23.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:23.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:24.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:24.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:24.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:24.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:25.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:25.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:25.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:25.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:26.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:26.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:26.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:26.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:27.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:27.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:27.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:27.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:28.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:28.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:28.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:28.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:29.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:29.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:29.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:29.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:30.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:30.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:30.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:30.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:31.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:31.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:31.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:31.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:32.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:32.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:32.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:32.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:33.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:33.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:33.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:33.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:34.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:34.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:34.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:34.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:35.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:35.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:35.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:35.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:36.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:36.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:37.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:37.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:37.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:37.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:38.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:38.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:38.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:38.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:39.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:39.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:39.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:39.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:40.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:40.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:40.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:40.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:41.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:41.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:41.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:41.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:42.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:42.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:42.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:42.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:43.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:43.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:43.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:43.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:44.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:44.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:44.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:44.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:45.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:45.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:45.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:45.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:46.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:46.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:46.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:46.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:47.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:47.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:47.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:47.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:48.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:48.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:48.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:48.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:49.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:49.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:49.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:49.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:50.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:50.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:50.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:50.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:51.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:51.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:51.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:51.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:52.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:52.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:52.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:52.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:53.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:53.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:53.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:53.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:54.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:54.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:55.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:55.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:55.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:55.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:56.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:56.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:56.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:56.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:56.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:56.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:57.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:57.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:57.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:57.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:58.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:58.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:59.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:57:59.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:57:59.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:57:59.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:00.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:00.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:00.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:00.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:01.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:01.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:01.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:01.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:02.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:02.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:02.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:02.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:03.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:03.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:03.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:03.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:04.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:04.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:04.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:04.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:05.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:05.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:05.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:05.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:06.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:06.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:06.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:06.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:07.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:07.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:07.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:07.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:08.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:08.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:08.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:08.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:09.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:09.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:09.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:09.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:10.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:10.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:10.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:10.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:11.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:11.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:11.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:11.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:12.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:12.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:12.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:12.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:13.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:13.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:13.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:13.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:14.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:14.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:14.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:14.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:15.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:15.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:15.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:15.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:16.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:16.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:16.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:16.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:17.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:16.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:17.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:17.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:18.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:18.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:18.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:18.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:19.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:19.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:19.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:19.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:20.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:20.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:20.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:20.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:21.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:21.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:21.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:21.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:22.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:22.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:22.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:22.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:23.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:23.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:23.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:23.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:24.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:24.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:24.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:24.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:25.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:25.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:25.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:25.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:26.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:26.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:26.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:26.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:27.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:27.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:27.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:27.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:28.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:28.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:28.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:28.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:29.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:29.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:29.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:29.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:30.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:30.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:30.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:30.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:31.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:31.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:31.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:31.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:32.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:32.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:32.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:32.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:33.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:33.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:33.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:33.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:34.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:34.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:34.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:34.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:35.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:35.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:35.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:35.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:36.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:36.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:36.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:36.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:37.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:37.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:37.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:37.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:38.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:38.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:38.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:38.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:39.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:39.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:39.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:39.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:40.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:40.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:40.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:40.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:41.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:41.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:41.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:41.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:42.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:42.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:42.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:42.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:43.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:43.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:43.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:43.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:44.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:44.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:44.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:44.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:45.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:45.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:45.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:45.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:46.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:46.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:46.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:46.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:47.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:47.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:47.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:47.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:48.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:48.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:48.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:48.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:49.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:49.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:49.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:49.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:50.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:50.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:50.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:50.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:51.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:51.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:51.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:51.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:52.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:52.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:52.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:52.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:53.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:53.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:53.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:53.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:54.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:54.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:54.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:54.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:55.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:55.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:55.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:55.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:56.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:56.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:56.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:56.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:57.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:57.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:57.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:57.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:58.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:58.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:58.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:58.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:59.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:58:59.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:58:59.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:58:59.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:00.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:00.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:00.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:00.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:01.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:01.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:01.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:01.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:02.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:02.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:02.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:02.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:03.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:03.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:03.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:03.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:04.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:04.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:04.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:04.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:05.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:05.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:05.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:05.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:06.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:06.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:06.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:06.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:07.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:07.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:07.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:07.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:08.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:08.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:08.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:08.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:09.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:09.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:09.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:09.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:10.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:10.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:10.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:10.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:11.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:11.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:11.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:11.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:12.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:12.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:12.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:12.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:13.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:13.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:13.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:13.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:14.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:14.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:14.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:14.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:15.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:15.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:15.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:15.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:16.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:16.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:16.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:16.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:17.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:17.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:17.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:17.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:18.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:18.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:18.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:18.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:19.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:19.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:19.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:19.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:20.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:20.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:20.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:20.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:21.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:21.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:21.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:21.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:22.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:22.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:22.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:22.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:23.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:23.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:23.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:23.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:24.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:24.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:24.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:24.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:25.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:25.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:25.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:25.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:26.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:26.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:26.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:26.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:27.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:27.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:27.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:27.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:28.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:28.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:28.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:28.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:29.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:29.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:29.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:29.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:30.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:30.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:30.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:30.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:31.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:31.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:31.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:31.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:32.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:32.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:32.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:32.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:33.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:33.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:33.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:33.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:34.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:34.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:34.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:34.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:35.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:35.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:35.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:35.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:36.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:36.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:36.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:36.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:37.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:37.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:37.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:37.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:38.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:38.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:38.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:38.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:39.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:39.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:39.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:39.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:40.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:40.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:40.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:40.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:41.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:41.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:41.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:41.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:42.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:42.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:42.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:42.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:43.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:43.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:43.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:43.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:44.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:44.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:44.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:44.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:45.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:45.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:45.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:45.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:46.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:46.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:46.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:46.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:47.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:47.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:47.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:47.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:48.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:48.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:48.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:48.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:49.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:49.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:49.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:49.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:50.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:50.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:50.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:50.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:51.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:51.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:51.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:51.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:52.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:52.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:52.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:52.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:53.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:53.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:53.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:53.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:54.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:54.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:54.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:54.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:55.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:55.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:55.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:55.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:56.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:56.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:56.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:56.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:57.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:57.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:57.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:57.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:58.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:58.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:58.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:58.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:59.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T03:59:59.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T03:59:59.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T03:59:59.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:00.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:00.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:00.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:00.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:01.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:01.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:01.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:01.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:02.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:02.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:02.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:02.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:03.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:03.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:03.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:03.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:04.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:04.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:04.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:04.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:05.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:05.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:05.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:05.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:06.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:06.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:06.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:06.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:07.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:07.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:07.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:07.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:08.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:08.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:08.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:08.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:09.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:09.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:09.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:09.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:10.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:10.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:10.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:10.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:11.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:11.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:11.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:11.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:12.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:12.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:12.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:12.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:13.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:13.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:13.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:13.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:14.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:14.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:14.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:14.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:15.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:15.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:15.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:15.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:16.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:16.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:16.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:16.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:17.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:17.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:17.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:17.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:18.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:18.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:18.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:18.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:19.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:19.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:19.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:19.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:20.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:20.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:20.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:20.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:21.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:21.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:21.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:21.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:22.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:22.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:22.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:22.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:23.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:23.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:23.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:23.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:24.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:24.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:24.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:24.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:25.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:25.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:25.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:25.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:26.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:26.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:26.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:26.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:27.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:27.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:27.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:27.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:28.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:28.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:28.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:28.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:29.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:29.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:29.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:29.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:30.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:30.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:30.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:30.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:31.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:31.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:31.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:31.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:32.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:32.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:32.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:32.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:33.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:33.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:33.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:33.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:34.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:34.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:34.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:34.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:35.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:35.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:35.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:35.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:36.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:36.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:36.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:36.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:37.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:37.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:37.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:37.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:38.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:38.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:38.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:38.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:39.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:39.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:39.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:39.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:40.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:40.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:40.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:40.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:41.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:41.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:41.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:41.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:42.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:42.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:42.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:42.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:43.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:43.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:43.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:43.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:44.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:44.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:44.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:44.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:45.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:45.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:45.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:45.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:46.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:46.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:46.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:46.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:47.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:47.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:47.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:47.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:48.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:48.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:48.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:48.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:49.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:49.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:49.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:49.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:50.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:50.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:50.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:50.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:51.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:51.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:51.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:51.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:52.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:52.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:52.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:52.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:53.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:53.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:53.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:53.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:54.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:54.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:54.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:54.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:55.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:55.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:55.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:55.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:56.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:56.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:56.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:56.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:57.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:57.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:57.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:57.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:58.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:58.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:58.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:58.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:59.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:00:59.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:00:59.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:00:59.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:00.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:00.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:00.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:00.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:01.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:01.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:01.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:01.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:02.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:02.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:02.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:02.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:03.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:03.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:03.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:03.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:04.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:04.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:04.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:04.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:05.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:05.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:05.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:05.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:06.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:06.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:06.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:06.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:07.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:07.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:07.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:07.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:08.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:08.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:08.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:08.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:09.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:09.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:09.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:09.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:10.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:10.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:10.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:10.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:11.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:11.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:11.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:11.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:12.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:12.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:12.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:12.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:13.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:13.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:13.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:13.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:14.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:14.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:14.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:14.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:15.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:15.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:15.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:15.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:16.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:16.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:16.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:16.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:17.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:17.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:17.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:17.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:18.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:18.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:18.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:18.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:19.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:19.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:19.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:19.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:20.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:20.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:20.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:20.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:21.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:21.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:21.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:21.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:22.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:22.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:22.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:22.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:23.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:23.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:23.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:23.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:24.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:24.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:24.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:24.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:25.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:25.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:25.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:25.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:26.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:26.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:26.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:26.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:27.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:27.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:27.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:27.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:28.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:28.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:28.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:28.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:29.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:29.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:29.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:29.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:30.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:30.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:30.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:30.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:31.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:31.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:31.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:31.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:32.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:32.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:32.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:32.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:33.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:33.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:33.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:33.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:34.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:34.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:34.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:34.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:35.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:35.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:35.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:35.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:36.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:36.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:36.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:36.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:37.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:37.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:37.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:37.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:38.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:38.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:38.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:38.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:39.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:39.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:39.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:39.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:40.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:40.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:40.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:40.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:41.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:41.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:41.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:41.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:42.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:42.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:42.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:42.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:43.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:43.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:43.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:43.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:44.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:44.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:44.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:44.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:45.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:45.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:45.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:45.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:46.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:46.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:46.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:46.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:47.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:47.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:47.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:47.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:48.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:48.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:48.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:48.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:49.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:49.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:49.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:49.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:50.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:50.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:50.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:50.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:51.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:51.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:51.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:51.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:52.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:52.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:52.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:52.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:53.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:53.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:53.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:53.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:54.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:54.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:54.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:54.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:55.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:55.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:56.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:55.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:56.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:56.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:56.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:56.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:57.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:57.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:57.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:57.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:58.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:58.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:58.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:58.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:59.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:01:59.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:01:59.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:01:59.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:00.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:00.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:00.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:00.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:01.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:01.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:01.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:01.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:02.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:02.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:02.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:02.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:03.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:03.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:03.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:03.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:04.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:04.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:04.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:04.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:05.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:05.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:05.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:05.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:06.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:06.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:06.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:06.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:07.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:07.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:07.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:07.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:08.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:08.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:08.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:08.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:09.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:09.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:09.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:09.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:10.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:10.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:10.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:10.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:11.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:11.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:11.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:11.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:12.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:12.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:12.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:12.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:13.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:13.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:13.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:13.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:14.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:14.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:14.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:14.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:15.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:15.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:15.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:15.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:16.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:16.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:16.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:16.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:17.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:17.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:17.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:17.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:18.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:18.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:18.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:18.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:19.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:19.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:19.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:19.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:20.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:20.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:20.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:20.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:21.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:21.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:21.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:21.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:22.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:22.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:22.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:22.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:23.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:23.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:23.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:23.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:24.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:24.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:24.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:24.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:25.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:25.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:25.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:25.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:26.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:26.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:26.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:26.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:27.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:27.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:27.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:27.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:28.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:28.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:28.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:28.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:29.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:29.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:29.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:29.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:30.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:30.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:30.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:30.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:31.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:31.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:31.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:31.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:32.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:32.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:32.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:32.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:33.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:33.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:33.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:33.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:34.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:34.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:34.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:34.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:35.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:35.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:35.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:35.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:36.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:36.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:36.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:36.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:37.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:37.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:37.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:37.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:38.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:38.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:38.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:38.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:39.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:39.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:39.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:39.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:40.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:40.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:40.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:40.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:41.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:41.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:41.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:41.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:42.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:42.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:42.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:42.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:43.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:43.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:43.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:43.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:44.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:44.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:44.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:44.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:45.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:45.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:45.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:45.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:46.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:46.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:46.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:46.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:47.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:47.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:47.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:47.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:48.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:48.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:48.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:48.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:49.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:49.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:49.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:49.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:50.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:50.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:50.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:50.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:51.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:51.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:51.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:51.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:52.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:52.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:52.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:52.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:53.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:53.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:53.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:53.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:54.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:54.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:54.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:54.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:55.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:55.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:55.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:55.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:56.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:56.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:56.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:56.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:57.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:57.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:57.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:57.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:58.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:58.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:58.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:58.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:59.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:02:59.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:02:59.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:02:59.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:00.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:00.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:00.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:00.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:01.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:01.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:01.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:01.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:02.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:02.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:02.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:02.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:03.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:03.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:03.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:03.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:04.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:04.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:04.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:04.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:05.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:05.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:05.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:05.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:06.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:06.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:06.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:06.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:07.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:07.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:07.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:07.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:08.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:08.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:08.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:08.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:09.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:09.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:09.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:09.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:10.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:10.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:10.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:10.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:11.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:11.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:11.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:11.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:12.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:12.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:12.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:12.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:13.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:13.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:13.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:13.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:14.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:14.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:14.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:14.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:15.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:15.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:15.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:15.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:16.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:16.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:16.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:16.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:17.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:17.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:17.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:17.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:18.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:18.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:18.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:18.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:19.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:19.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:19.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:19.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:20.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:20.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:20.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:20.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:21.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:21.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:21.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:21.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:22.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:22.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:22.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:22.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:23.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:23.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:23.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:23.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:24.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:24.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:24.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:24.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:25.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:25.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:25.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:25.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:26.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:26.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:26.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:26.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:27.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:27.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:27.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:27.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:28.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:28.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:28.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:28.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:29.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:29.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:29.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:29.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:30.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:30.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:30.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:30.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:31.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:31.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:31.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:31.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:32.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:32.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:32.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:32.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:33.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:33.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:34.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:34.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:34.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:34.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:35.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:35.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:35.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:35.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:36.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:36.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:36.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:36.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:37.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:37.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:37.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:37.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:38.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:38.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:38.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:38.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:39.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:39.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:39.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:39.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:40.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:40.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:40.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:40.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:41.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:41.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:41.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:41.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:42.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:42.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:42.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:42.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:43.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:43.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:43.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:43.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:44.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:44.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:44.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:44.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:45.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:45.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:45.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:45.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:46.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:46.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:46.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:46.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:47.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:47.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:47.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:47.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:48.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:48.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:48.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:48.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:49.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:49.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:49.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:49.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:50.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:50.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:50.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:50.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:51.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:51.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:51.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:51.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:52.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:52.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:52.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:52.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:53.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:53.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:53.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:53.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:54.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:54.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:54.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:54.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:55.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:55.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:55.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:55.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:56.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:56.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:56.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:56.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:57.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:57.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:57.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:57.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:58.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:58.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:58.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:58.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:59.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:03:59.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:03:59.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:03:59.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:00.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:00.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:00.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:00.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:01.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:01.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:01.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:01.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:02.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:02.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:02.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:02.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:03.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:03.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:03.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:03.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:04.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:04.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:04.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:04.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:05.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:05.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:05.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:05.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:06.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:06.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:06.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:06.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:07.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:07.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:07.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:07.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:08.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:08.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:08.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:08.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:09.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:09.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:09.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:09.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:10.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:10.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:10.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:10.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:11.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:11.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:11.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:11.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:12.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:12.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:12.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:12.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:13.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:13.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:13.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:13.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:14.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:14.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:14.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:14.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:15.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:15.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:15.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:15.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:16.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:16.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:16.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:16.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:17.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:17.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:17.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:17.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:18.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:18.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:18.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:18.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:19.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:19.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:19.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:19.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:20.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:20.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:20.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:20.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:21.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:21.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:21.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:21.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:22.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:22.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:22.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:22.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:23.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:23.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:23.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:23.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:24.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:24.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:24.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:24.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:25.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:25.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:25.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:25.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:26.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:26.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:26.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:26.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:27.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:27.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:27.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:27.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:28.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:28.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:28.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:28.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:29.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:29.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:29.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:29.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:30.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:30.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:30.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:30.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:31.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:31.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:31.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:31.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:32.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:32.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:32.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:32.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:33.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:33.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:33.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:33.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:34.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:34.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:34.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:34.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:35.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:35.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:35.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:35.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:36.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:36.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:36.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:36.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:37.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:37.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:37.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:37.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:38.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:38.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:38.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:38.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:39.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:39.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:39.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:39.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:40.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:40.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:40.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:40.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:41.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:41.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:41.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:41.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:42.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:42.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:42.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:42.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:43.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:43.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:43.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:43.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:44.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:44.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:44.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:44.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:45.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:45.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:45.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:45.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:46.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:46.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:46.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:46.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:47.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:47.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:47.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:47.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:48.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:48.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:48.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:48.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:49.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:49.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:49.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:49.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:50.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:50.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:50.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:50.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:51.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:51.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:51.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:51.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:52.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:52.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:52.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:52.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:53.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:53.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:53.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:53.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:54.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:54.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:54.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:54.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:55.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:55.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:55.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:55.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:56.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:56.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:57.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:56.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:57.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:57.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:58.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:58.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:58.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:58.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:59.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:04:59.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:04:59.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:04:59.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:00.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:00.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:00.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:00.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:01.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:01.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:01.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:01.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:02.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:02.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:02.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:02.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:03.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:03.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:03.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:03.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:03.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:03.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:04.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:04.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:05.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:05.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:05.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:05.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:06.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:06.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:06.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:06.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:07.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:07.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:07.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:07.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:08.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:08.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:08.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:08.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:09.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:08.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:09.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:09.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:09.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:09.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:10.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:10.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:10.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:10.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:11.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:11.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:12.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:12.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:12.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:12.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:12.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:12.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:13.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:13.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:13.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:13.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:14.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:14.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:14.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:14.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:15.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:15.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:15.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:15.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:16.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:16.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:16.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:16.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:17.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:17.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:17.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:17.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:18.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:18.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:18.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:18.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:19.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:19.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:19.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:19.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:20.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:20.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:20.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:20.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:21.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:21.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:21.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:21.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:22.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:22.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:22.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:22.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:23.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:23.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:23.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:23.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:24.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:24.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:24.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:24.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:25.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:25.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:26.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:25.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:26.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:26.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:27.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:27.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:27.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:27.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:28.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:28.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:28.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:28.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:29.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:29.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:29.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:29.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:30.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:29.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:30.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:30.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:30.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:30.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:31.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:31.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:32.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:32.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:32.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:32.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:33.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:33.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:33.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:33.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:34.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:34.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:34.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:34.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:35.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:35.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:35.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:35.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:36.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:36.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:36.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:36.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:37.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:37.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:37.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:37.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:38.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:38.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:38.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:38.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:39.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:39.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:39.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:39.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:40.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:40.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:40.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:40.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:41.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:41.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:41.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:41.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:42.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:42.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:42.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:42.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:43.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:43.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:43.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:43.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:44.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:44.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:44.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:44.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:45.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:45.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:45.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:45.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:46.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:46.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:46.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:46.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:47.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:47.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:47.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:47.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:48.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:48.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:48.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:48.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:49.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:49.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:49.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:49.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:50.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:50.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:50.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:50.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:51.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:51.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:51.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:51.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:52.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:52.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:52.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:52.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:53.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:53.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:53.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:53.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:54.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:54.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:54.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:54.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:55.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:55.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:55.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:55.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:55.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:55.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:56.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:56.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:56.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:56.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:57.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:57.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:57.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:57.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:58.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:58.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:58.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:58.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:59.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:05:59.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:05:59.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:05:59.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:00.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:00.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:01.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:01.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:01.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:01.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:02.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:02.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:02.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:02.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:03.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:03.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:03.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:03.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:04.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:03.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:04.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:04.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:05.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:04.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:05.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:05.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:06.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:05.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:06.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:06.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:06.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:06.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:07.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:07.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:08.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:08.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:08.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:08.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:09.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:09.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:09.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:09.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:10.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:10.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:10.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:10.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:11.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:11.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:11.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:11.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:12.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:11.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:12.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:12.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:12.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:12.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:13.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:13.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:13.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:13.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:14.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:14.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:15.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:14.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:15.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:15.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:15.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:15.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:16.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:16.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:16.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:16.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:17.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:17.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:17.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:17.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:18.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:18.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:18.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:18.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:19.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:19.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:19.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:19.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:20.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:20.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:21.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:20.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:21.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:21.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:21.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:21.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:22.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:22.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:22.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:22.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:23.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:23.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:23.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:23.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:24.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:24.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:24.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:24.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:25.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:25.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:25.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:25.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:26.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:26.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:26.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:26.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:27.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:27.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:27.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:27.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:28.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:28.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:28.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:28.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:29.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:29.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:29.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:29.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:30.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:30.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:30.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:30.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:31.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:31.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:31.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:31.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:32.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:32.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:32.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:33.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:33.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:34.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:34.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:34.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:34.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:35.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:35.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:35.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:35.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:36.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:36.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:36.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:36.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:37.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:36.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:37.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:37.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:38.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:38.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:38.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:38.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:39.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:39.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:39.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:39.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:39.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:39.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:40.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:40.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:40.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:40.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:41.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:41.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:41.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:41.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:42.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:42.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:42.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:42.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:43.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:43.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:43.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:43.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:44.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:44.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:45.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:45.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:46.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:45.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:46.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:46.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:47.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:47.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:47.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:47.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:48.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:48.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:48.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:48.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:48.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:48.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:49.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:49.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:49.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:49.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:50.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:50.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:51.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:51.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:51.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:51.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:52.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:51.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:52.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:52.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:53.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:53.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:53.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:53.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:54.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:53.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:54.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:54.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:55.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:55.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:55.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:55.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:56.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:56.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:56.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:56.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:57.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:57.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:57.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:57.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:58.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:58.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:58.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:58.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:59.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:06:59.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:06:59.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:06:59.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:00.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:00.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:00.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:00.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:01.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:01.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:01.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:01.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:02.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:02.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:02.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:02.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:03.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:03.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:03.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:03.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:04.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:04.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:04.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:04.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:04.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:04.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:05.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:05.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:06.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:06.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:06.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:06.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:07.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:07.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:07.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:07.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:08.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:07.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:08.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:08.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:08.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:08.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:09.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:09.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:10.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:09.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:10.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:10.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:11.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:11.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:11.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:11.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:12.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:12.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:12.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:12.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:13.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:13.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:13.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:13.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:14.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:14.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:14.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:14.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:15.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:15.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:15.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:15.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:16.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:16.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:16.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:16.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:17.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:17.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:17.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:17.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:18.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:18.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:18.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:18.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:19.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:19.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:19.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:19.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:20.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:20.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:20.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:20.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:21.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:21.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:21.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:21.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:22.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:22.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:22.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:22.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:23.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:23.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:23.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:23.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:24.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:24.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:24.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:24.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:25.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:25.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:25.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:25.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:26.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:26.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:26.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:26.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:27.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:27.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:27.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:27.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:27.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:27.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:28.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:28.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:28.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:28.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:29.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:29.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:29.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:29.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:30.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:30.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:30.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:30.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:31.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:31.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:31.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:31.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:32.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:32.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:32.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:32.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:33.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:33.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:33.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:33.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:34.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:34.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:35.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:35.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:35.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:35.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:35.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:35.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:36.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:36.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:37.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:37.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:37.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:37.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:38.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:38.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:38.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:38.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:39.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:39.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:39.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:39.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:40.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:40.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:40.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:40.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:41.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:41.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:41.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:41.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:42.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:42.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:42.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:42.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:43.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:43.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:43.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:43.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:44.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:44.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:44.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:44.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:45.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:45.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:45.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:45.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:46.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:46.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:46.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:46.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:47.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:47.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:47.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:47.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:48.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:48.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:48.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:48.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:49.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:49.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:49.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:49.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:50.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:50.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:50.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:50.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:51.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:51.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:51.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:51.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:52.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:52.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:52.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:52.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:53.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:53.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:53.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:53.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:54.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:54.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:54.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:54.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:55.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:55.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:55.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:55.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:56.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:56.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:56.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:56.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:57.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:57.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:57.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:57.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:58.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:58.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:58.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:58.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:59.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:07:59.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:07:59.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:07:59.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:00.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:00.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:00.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:00.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:01.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:01.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:01.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:01.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:02.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:02.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:02.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:02.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:03.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:03.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:03.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:03.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:04.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:04.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:04.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:04.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:05.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:05.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:05.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:05.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:06.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:06.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:06.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:06.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:07.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:07.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:07.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:07.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:08.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:08.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:08.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:08.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:09.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:09.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:09.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:09.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:10.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:10.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:10.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:10.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:11.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:11.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:11.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:11.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:12.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:12.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:12.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:12.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:13.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:13.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:13.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:13.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:14.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:14.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:14.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:14.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:15.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:15.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:15.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:15.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:16.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:16.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:16.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:16.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:17.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:17.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:17.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:17.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:18.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:18.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:18.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:18.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:19.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:18.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:19.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:19.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:20.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:20.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:20.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:20.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:21.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:21.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:21.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:21.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:22.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:22.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:22.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:22.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:23.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:23.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:23.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:23.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:24.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:24.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:24.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:25.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:25.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:25.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:25.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:26.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:26.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:26.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:26.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:27.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:27.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:27.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:27.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:28.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:28.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:28.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:28.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:29.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:29.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:29.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:29.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:30.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:30.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:30.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:30.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:31.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:30.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:31.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:31.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:32.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:31.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:32.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:32.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:33.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:33.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:33.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:33.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:33.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:33.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:34.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:34.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:35.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:35.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:35.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:35.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:35.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:35.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:36.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:36.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:36.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:36.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:37.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:37.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:37.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:37.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:38.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:38.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:38.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:38.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:39.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:39.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:39.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:39.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:40.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:40.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:41.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:41.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:41.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:41.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:42.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:42.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:42.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:42.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:43.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:43.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:43.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:43.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:44.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:44.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:44.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:44.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:45.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:45.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:45.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:45.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:46.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:46.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:46.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:46.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:47.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:47.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:47.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:47.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:48.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:48.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:48.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:48.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:49.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:49.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:49.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:49.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:50.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:50.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:50.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:50.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:51.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:51.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:51.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:51.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:52.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:52.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:52.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:52.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:53.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:53.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:53.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:53.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:54.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:54.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:54.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:54.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:55.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:55.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:55.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:55.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:56.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:56.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:56.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:56.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:57.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:57.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:57.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:57.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:58.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:58.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:58.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:58.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:59.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:08:59.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:08:59.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:08:59.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:00.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:00.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:00.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:00.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:01.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:01.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:01.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:01.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:02.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:02.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:02.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:02.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:03.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:03.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:03.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:03.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:04.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:04.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:04.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:04.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:05.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:05.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:05.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:05.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:06.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:06.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:06.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:06.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:07.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:07.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:07.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:07.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:08.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:08.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:08.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:08.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:09.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:09.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:09.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:09.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:10.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:10.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:10.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:10.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:11.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:11.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:11.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:11.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:12.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:12.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:12.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:12.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:13.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:13.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:13.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:13.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:14.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:13.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:14.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:14.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:15.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:15.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:15.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:15.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:16.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:16.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:16.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:16.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:17.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:17.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:17.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:17.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:18.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:18.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:18.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:18.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:19.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:19.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:19.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:19.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:20.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:20.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:20.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:20.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:21.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:21.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:21.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:21.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:22.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:22.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:22.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:22.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:23.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:23.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:23.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:23.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:24.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:24.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:24.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:24.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:25.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:25.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:25.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:25.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:26.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:26.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:26.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:26.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:27.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:27.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:27.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:27.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:28.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:28.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:28.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:28.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:29.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:29.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:29.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:29.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:30.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:30.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:30.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:30.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:31.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:31.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:31.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:31.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:32.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:32.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:32.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:32.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:33.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:33.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:33.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:33.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:34.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:34.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:34.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:34.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:35.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:35.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:35.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:35.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:36.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:36.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:36.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:36.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:37.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:37.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:37.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:37.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:38.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:38.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:38.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:38.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:39.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:39.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:39.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:39.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:40.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:40.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:40.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:40.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:41.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:41.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:41.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:41.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:42.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:42.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:42.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:42.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:43.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:43.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:43.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:43.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:44.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:44.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:44.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:44.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:45.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:45.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:45.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:45.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:46.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:46.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:46.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:46.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:47.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:47.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:47.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:47.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:48.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:48.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:48.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:48.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:49.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:49.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:49.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:49.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:50.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:50.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:50.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:50.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:51.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:51.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:51.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:51.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:52.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:52.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:52.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:52.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:53.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:53.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:53.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:53.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:54.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:54.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:54.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:54.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:55.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:55.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:55.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:55.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:56.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:56.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:56.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:56.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:57.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:57.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:57.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:57.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:58.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:58.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:58.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:58.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:59.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:09:59.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:09:59.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:09:59.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:00.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:00.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:00.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:00.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:01.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:01.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:01.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:01.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:02.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:02.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:02.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:02.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:03.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:03.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:03.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:03.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:04.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:04.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:04.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:04.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:05.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:05.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:05.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:05.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:06.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:06.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:06.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:07.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:07.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:07.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:07.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:08.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:08.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:08.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:08.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:09.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:09.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:09.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:09.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:10.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:10.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:10.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:10.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:11.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:11.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:11.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:11.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:12.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:12.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:12.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:12.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:13.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:13.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:14.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:14.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:14.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:14.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:15.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:15.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:15.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:15.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:16.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:15.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:16.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:16.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:16.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:16.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:17.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:17.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:18.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:17.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:18.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:18.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:18.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:18.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:19.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:19.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:19.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:19.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:20.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:20.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:21.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:21.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:21.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:21.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:22.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:21.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:22.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:22.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:23.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:23.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:23.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:23.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:24.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:23.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:24.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:24.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:24.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:24.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:25.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:25.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:25.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:25.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:26.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:26.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:26.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:26.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:27.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:27.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:27.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:27.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:28.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:28.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:29.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:29.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:29.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:29.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:30.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:30.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:30.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:30.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:31.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:31.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:31.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:31.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:32.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:32.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:32.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:32.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:33.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:33.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:33.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:33.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:34.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:34.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:34.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:34.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:35.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:35.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:35.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:35.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:36.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:36.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:36.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:36.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:37.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:37.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:37.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:37.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:38.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:38.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:38.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:38.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:39.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:39.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:39.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:39.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:40.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:40.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:40.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:40.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:41.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:41.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:41.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:41.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:41.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:41.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:42.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:42.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:42.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:42.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:43.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:43.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:43.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:43.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:44.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:44.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:44.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:44.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:45.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:45.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:46.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:46.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:46.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:46.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:47.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:47.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:47.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:47.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:48.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:48.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:48.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:48.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:49.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:49.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:49.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:49.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:50.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:50.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:50.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:50.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:51.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:51.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:51.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:51.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:52.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:52.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:52.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:52.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:53.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:53.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:53.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:53.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:54.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:54.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:54.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:54.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:55.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:55.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:55.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:55.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:56.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:56.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:56.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:56.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:57.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:57.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:57.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:57.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:58.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:58.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:58.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:58.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:59.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:10:59.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:10:59.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:10:59.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:00.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:00.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:00.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:00.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:01.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:01.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:01.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:01.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:02.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:02.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:02.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:02.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:03.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:03.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:03.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:03.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:04.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:04.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:04.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:04.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:05.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:05.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:05.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:05.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:06.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:06.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:06.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:06.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:07.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:07.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:07.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:07.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:08.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:08.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:08.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:08.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:09.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:09.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:09.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:09.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:10.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:10.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:10.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:10.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:11.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:11.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:11.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:11.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:12.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:12.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:12.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:12.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:13.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:13.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:13.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:13.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:14.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:14.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:14.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:14.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:15.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:15.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:15.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:15.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:16.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:16.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:16.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:16.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:17.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:17.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:17.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:17.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:18.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:18.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:18.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:18.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:19.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:19.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:19.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:19.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:20.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:20.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:20.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:20.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:21.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:21.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:21.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:21.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:22.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:22.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:22.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:22.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:23.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:23.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:23.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:23.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:24.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:24.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:24.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:24.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:25.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:25.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:25.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:25.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:26.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:26.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:26.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:26.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:27.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:27.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:27.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:27.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:28.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:28.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:28.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:28.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:29.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:29.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:29.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:29.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:30.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:30.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:30.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:30.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:31.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:31.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:31.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:31.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:32.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:32.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:32.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:32.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:33.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:33.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:33.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:33.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:34.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:34.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:34.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:34.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:35.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:35.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:35.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:35.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:36.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:36.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:36.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:36.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:37.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:37.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:37.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:37.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:38.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:38.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:38.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:38.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:39.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:39.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:39.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:39.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:40.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:40.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:40.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:40.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:41.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:41.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:41.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:41.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:42.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:42.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:42.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:42.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:43.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:43.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:43.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:43.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:44.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:44.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:44.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:44.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:45.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:45.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:45.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:45.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:46.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:46.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:46.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:46.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:47.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:47.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:47.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:47.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:48.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:48.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:48.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:48.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:49.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:49.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:49.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:49.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:50.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:50.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:50.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:50.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:51.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:51.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:51.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:51.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:52.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:52.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:52.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:52.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:53.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:53.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:53.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:53.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:54.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:54.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:54.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:54.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:55.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:55.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:55.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:55.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:56.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:56.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:56.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:56.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:57.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:57.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:57.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:57.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:58.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:58.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:58.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:58.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:59.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:11:59.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:11:59.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:11:59.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:00.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:00.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:00.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:00.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:01.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:01.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:01.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:01.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:02.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:02.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:02.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:02.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:03.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:03.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:03.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:03.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:04.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:04.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:04.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:04.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:05.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:05.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:05.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:05.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:06.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:06.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:06.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:06.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:07.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:07.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:07.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:07.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:08.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:08.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:08.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:08.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:09.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:09.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:09.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:09.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:10.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:10.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:10.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:10.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:11.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:11.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:11.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:11.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:12.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:12.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:12.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:12.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:13.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:13.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:13.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:13.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:14.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:14.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:14.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:14.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:15.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:15.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:15.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:15.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:16.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:16.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:16.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:16.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:17.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:17.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:17.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:17.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:18.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:18.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:18.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:18.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:19.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:19.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:19.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:19.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:20.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:20.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:20.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:20.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:21.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:21.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:21.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:21.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:22.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:22.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:22.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:22.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:23.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:23.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:23.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:23.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:24.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:24.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:24.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:24.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:25.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:25.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:25.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:25.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:26.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:26.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:26.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:26.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:27.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:27.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:27.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:27.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:28.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:28.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:28.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:28.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:29.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:29.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:29.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:29.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:30.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:30.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:30.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:30.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:31.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:31.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:31.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:31.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:32.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:32.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:32.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:32.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:33.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:33.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:33.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:33.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:34.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:34.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:34.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:34.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:35.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:35.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:35.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:35.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:36.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:36.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:36.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:36.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:37.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:37.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:37.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:37.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:38.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:38.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:38.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:38.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:39.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:39.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:39.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:39.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:40.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:40.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:40.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:40.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:41.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:41.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:41.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:41.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:42.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:42.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:42.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:42.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:43.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:43.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:43.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:43.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:44.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:44.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:44.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:44.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:45.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:45.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:45.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:45.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:46.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:46.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:46.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:46.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:47.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:47.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:47.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:47.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:48.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:48.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:48.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:48.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:49.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:49.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:49.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:49.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:50.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:50.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:50.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:50.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:51.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:51.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:51.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:51.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:52.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:52.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:52.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:52.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:53.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:53.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:53.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:53.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:54.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:54.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:54.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:54.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:55.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:55.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:55.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:55.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:56.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:56.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:56.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:56.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:57.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:57.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:57.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:57.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:58.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:58.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:58.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:58.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:58.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:12:58.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:12:59.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:12:59.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:00.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:00.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:00.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:00.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:01.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:01.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:01.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:01.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:01.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:01.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:02.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:02.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:02.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:02.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:03.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:03.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:03.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:03.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:04.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:04.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:04.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:04.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:05.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:05.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:05.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:05.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:06.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:06.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:06.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:06.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:07.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:07.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:07.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:07.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:08.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:08.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:08.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:08.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:09.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:09.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:09.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:09.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:10.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:10.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:10.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:10.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:11.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:11.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:11.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:11.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:12.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:12.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:12.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:12.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:13.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:13.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:13.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:13.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:14.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:14.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:14.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:14.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:15.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:15.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:15.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:15.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:16.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:16.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:16.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:16.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:17.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:17.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:17.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:17.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:18.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:18.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:18.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:18.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:19.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:19.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:19.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:19.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:20.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:20.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:20.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:20.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:21.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:21.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:21.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:21.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:22.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:22.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:22.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:22.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:23.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:23.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:23.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:23.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:24.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:24.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:24.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:24.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:25.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:25.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:25.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:25.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:26.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:26.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:26.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:26.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:27.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:27.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:27.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:27.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:28.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:28.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:28.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:28.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:29.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:29.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:29.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:29.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:30.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:30.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:30.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:30.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:31.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:31.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:31.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:31.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:32.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:32.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:32.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:32.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:33.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:33.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:33.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:33.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:34.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:34.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:34.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:34.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:35.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:35.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:36.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:36.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:36.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:36.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:37.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:37.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:37.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:37.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:38.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:38.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:38.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:38.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:39.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:38.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:39.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:39.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:39.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:39.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:40.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:40.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:40.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:40.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:41.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:41.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:42.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:42.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:42.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:42.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:43.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:43.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:43.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:43.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:44.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:44.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:44.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:44.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:45.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:45.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:45.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:45.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:46.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:46.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:46.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:46.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:47.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:47.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:47.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:47.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:48.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:48.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:48.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:48.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:49.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:49.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:49.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:49.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:50.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:50.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:50.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:50.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:51.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:51.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:51.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:51.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:52.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:52.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:52.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:52.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:53.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:53.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:53.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:53.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:54.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:54.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:54.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:54.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:55.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:55.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:55.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:55.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:56.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:56.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:56.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:56.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:57.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:57.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:57.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:57.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:58.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:58.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:58.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:58.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:59.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:13:59.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:13:59.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:13:59.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:00.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:00.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:00.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:00.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:01.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:01.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:01.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:01.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:02.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:02.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:02.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:02.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:03.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:03.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:03.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:03.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:04.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:04.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:04.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:04.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:05.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:05.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:05.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:05.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:06.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:06.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:06.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:06.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:07.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:07.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:07.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:07.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:08.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:08.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:08.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:08.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:09.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:09.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:09.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:09.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:10.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:10.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:10.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:10.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:11.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:11.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:11.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:11.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:12.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:12.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:12.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:12.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:13.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:13.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:13.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:13.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:14.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:14.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:14.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:14.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:15.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:15.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:15.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:15.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:16.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:16.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:16.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:16.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:17.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:17.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:17.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:17.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:18.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:18.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:18.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:18.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:19.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:19.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:19.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:19.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:20.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:20.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:20.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:20.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:21.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:21.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:21.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:21.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:22.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:22.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:22.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:22.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:23.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:23.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:23.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:23.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:24.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:24.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:24.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:24.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:25.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:25.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:25.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:25.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:26.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:26.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:26.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:26.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:27.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:27.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:27.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:27.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:28.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:28.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:28.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:28.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:29.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:29.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:29.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:29.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:30.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:30.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:30.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:30.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:31.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:31.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:31.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:31.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:32.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:32.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:32.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:32.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:33.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:33.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:33.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:33.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:34.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:34.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:34.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:34.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:35.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:35.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:35.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:35.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:36.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:36.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:36.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:36.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:37.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:37.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:37.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:37.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:38.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:38.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:38.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:38.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:39.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:39.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:39.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:39.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:40.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:40.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:40.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:40.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:41.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:41.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:41.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:41.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:42.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:42.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:42.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:42.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:43.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:43.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:43.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:43.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:44.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:44.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:44.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:44.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:45.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:45.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:45.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:45.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:46.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:46.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:46.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:46.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:47.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:47.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:47.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:47.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:48.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:48.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:48.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:48.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:49.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:49.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:49.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:49.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:50.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:50.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:50.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:50.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:51.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:51.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:51.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:51.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:52.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:52.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:52.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:52.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:53.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:53.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:53.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:53.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:54.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:54.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:54.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:54.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:55.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:55.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:55.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:55.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:56.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:56.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:56.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:56.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:57.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:57.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:57.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:57.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:58.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:58.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:59.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:59.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:14:59.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:14:59.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:00.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:14:59.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:00.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:00.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:00.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:00.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:01.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:01.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:01.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:01.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:02.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:02.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:02.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:02.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:03.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:03.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:03.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:03.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:04.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:04.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:05.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:04.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:05.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:05.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:05.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:05.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:06.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:06.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:06.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:06.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:07.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:07.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:07.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:07.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:08.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:08.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:08.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:08.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:09.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:09.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:09.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:09.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:10.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:10.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:10.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:10.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:11.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:11.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:11.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:11.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:12.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:12.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:12.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:12.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:13.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:13.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:13.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:13.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:14.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:14.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:14.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:14.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:15.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:15.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:15.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:15.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:16.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:16.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:16.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:16.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:17.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:17.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:17.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:17.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:18.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:18.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:18.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:18.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:19.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:19.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:19.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:19.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:20.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:20.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:20.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:20.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:21.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:21.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:21.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:21.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:22.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:22.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:22.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:22.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:23.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:23.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:23.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:23.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:24.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:24.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:24.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:24.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:25.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:25.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:25.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:25.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:26.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:26.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:26.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:26.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:27.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:27.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:27.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:27.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:28.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:28.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:28.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:28.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:29.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:29.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:29.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:29.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:30.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:30.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:30.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:30.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:31.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:31.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:31.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:31.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:32.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:32.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:32.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:32.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:33.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:33.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:33.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:33.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:34.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:34.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:34.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:34.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:35.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:35.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:35.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:35.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:36.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:36.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:36.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:36.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:37.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:37.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:37.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:37.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:38.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:38.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:39.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:39.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:39.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:39.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:40.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:40.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:40.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:40.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:41.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:41.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:41.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:41.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:42.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:42.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:42.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:42.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:43.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:43.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:43.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:43.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:44.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:44.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:44.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:44.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:45.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:45.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:45.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:45.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:46.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:46.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:46.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:46.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:47.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:47.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:47.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:47.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:48.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:48.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:48.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:48.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:49.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:49.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:49.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:49.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:50.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:50.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:50.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:50.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:51.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:51.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:51.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:51.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:52.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:52.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:52.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:52.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:53.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:53.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:53.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:53.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:54.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:54.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:54.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:54.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:55.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:55.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:55.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:55.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:56.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:56.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:56.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:56.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:57.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:57.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:57.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:57.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:58.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:58.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:58.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:58.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:59.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:15:59.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:15:59.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:15:59.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:00.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:00.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:00.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:00.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:01.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:01.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:01.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:01.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:02.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:02.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:02.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:02.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:03.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:03.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:03.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:03.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:04.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:04.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:04.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:04.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:05.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:05.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:05.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:05.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:06.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:06.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:06.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:06.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:07.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:06.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:07.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:07.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:07.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:07.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:08.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:08.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:08.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:08.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:09.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:09.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:10.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:10.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:10.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:10.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:10.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:10.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:11.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:11.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:11.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:11.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:12.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:12.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:13.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:13.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:13.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:13.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:14.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:14.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:14.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:14.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:15.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:15.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:15.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:15.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:16.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:16.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:16.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:16.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:17.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:17.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:17.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:17.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:18.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:18.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:18.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:18.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:19.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:19.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:19.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:19.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:20.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:20.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:20.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:20.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:21.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:21.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:21.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:21.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:22.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:22.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:22.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:22.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:23.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:23.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:23.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:23.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:24.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:24.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:24.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:24.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:25.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:25.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:25.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:25.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:26.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:26.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:26.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:26.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:27.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:27.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:27.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:27.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:28.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:28.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:28.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:28.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:29.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:29.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:29.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:29.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:30.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:30.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:30.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:30.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:31.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:31.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:31.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:31.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:32.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:32.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:32.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:32.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:33.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:33.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:33.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:33.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:33.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:33.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:34.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:34.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:35.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:35.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:35.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:35.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:35.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:35.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:36.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:36.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:36.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:36.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:37.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:37.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:37.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:37.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:38.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:38.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:38.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:38.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:39.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:39.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:39.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:39.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:40.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:40.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:40.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:40.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:41.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:41.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:41.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:41.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:42.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:42.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:42.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:42.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:43.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:43.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:43.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:43.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:44.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:44.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:44.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:44.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:45.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:45.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:45.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:45.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:46.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:46.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:46.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:46.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:47.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:47.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:47.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:47.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:48.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:48.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:48.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:48.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:49.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:49.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:49.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:49.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:50.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:50.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:50.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:50.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:51.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:51.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:51.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:51.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:52.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:52.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:52.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:52.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:53.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:53.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:53.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:53.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:54.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:54.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:54.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:54.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:55.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:55.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:55.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:55.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:56.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:56.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:56.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:56.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:57.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:57.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:57.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:57.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:58.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:58.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:58.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:58.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:59.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:16:59.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:16:59.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:16:59.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:00.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:00.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:00.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:00.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:01.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:01.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:01.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:01.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:02.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:02.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:02.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:02.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:03.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:03.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:03.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:03.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:04.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:04.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:04.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:04.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:05.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:05.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:05.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:05.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:06.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:06.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:06.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:06.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:07.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:07.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:07.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:07.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:08.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:08.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:08.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:08.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:09.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:09.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:09.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:09.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:10.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:10.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:10.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:10.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:11.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:11.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:11.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:11.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:12.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:12.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:12.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:12.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:13.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:13.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:13.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:13.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:14.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:14.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:14.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:14.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:15.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:15.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:15.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:15.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:16.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:16.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:16.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:16.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:17.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:17.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:17.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:17.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:18.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:18.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:18.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:18.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:19.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:19.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:19.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:19.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:20.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:20.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:20.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:20.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:21.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:21.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:21.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:21.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:22.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:22.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:22.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:22.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:23.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:23.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:23.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:23.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:24.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:24.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:24.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:24.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:25.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:25.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:25.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:25.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:26.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:26.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:26.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:26.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:27.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:27.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:27.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:27.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:28.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:28.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:28.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:28.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:29.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:29.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:29.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:29.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:30.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:30.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:30.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:30.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:31.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:31.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:31.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:31.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:32.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:32.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:32.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:32.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:33.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:33.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:33.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:33.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:34.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:34.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:34.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:34.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:35.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:35.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:35.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:35.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:36.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:36.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:36.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:36.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:37.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:37.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:37.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:37.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:38.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:38.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:38.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:38.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:39.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:39.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:39.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:39.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:40.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:40.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:40.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:40.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:41.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:41.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:41.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:41.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:42.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:42.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:42.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:42.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:43.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:43.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:43.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:43.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:44.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:44.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:44.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:44.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:45.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:45.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:45.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:45.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:46.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:46.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:46.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:46.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:47.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:47.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:48.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:48.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:48.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:48.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:48.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:48.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:49.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:49.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:49.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:49.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:50.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:50.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:50.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:50.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:51.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:51.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:51.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:51.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:52.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:52.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:52.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:52.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:53.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:53.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:53.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:53.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:54.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:54.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:54.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:54.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:55.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:55.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:55.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:55.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:56.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:56.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:56.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:56.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:57.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:57.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:58.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:57.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:58.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:58.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:58.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:58.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:59.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:17:59.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:17:59.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:17:59.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:00.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:00.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:00.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:00.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:01.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:01.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:01.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:01.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:02.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:02.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:02.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:02.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:03.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:03.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:03.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:03.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:04.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:04.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:04.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:04.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:05.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:05.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:05.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:05.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:06.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:06.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:06.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:06.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:07.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:07.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:07.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:07.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:08.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:08.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:08.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:08.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:09.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:09.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:09.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:09.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:10.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:10.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:10.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:10.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:11.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:11.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:11.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:11.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:12.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:12.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:12.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:12.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:13.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:13.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:13.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:13.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:14.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:14.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:14.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:14.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:15.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:15.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:15.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:15.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:16.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:16.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:16.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:16.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:17.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:17.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:18.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:18.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:18.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:18.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:19.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:19.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:19.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:19.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:20.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:20.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:20.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:20.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:21.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:21.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:21.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:21.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:22.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:22.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:22.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:22.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:22.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:22.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:23.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:23.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:24.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:24.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:24.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:24.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:25.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:25.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:25.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:25.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:26.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:26.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:26.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:26.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:27.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:27.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:27.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:27.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:28.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:28.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:28.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:28.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:28.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:28.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:29.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:29.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:29.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:29.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:30.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:30.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:30.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:30.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:31.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:31.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:31.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:31.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:32.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:32.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:32.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:32.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:33.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:33.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:33.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:33.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:34.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:34.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:34.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:34.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:35.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:35.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:35.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:35.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:36.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:36.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:36.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:36.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:37.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:37.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:38.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:37.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:38.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:38.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:39.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:39.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:39.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:39.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:39.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:39.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:40.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:40.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:40.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:40.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:41.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:41.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:41.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:41.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:42.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:42.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:42.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:42.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:43.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:43.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:43.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:43.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:44.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:44.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:44.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:44.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:45.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:45.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:45.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:45.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:46.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:46.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:46.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:46.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:47.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:47.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:47.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:47.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:48.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:48.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:48.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:48.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:49.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:49.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:49.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:49.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:50.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:50.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:50.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:50.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:51.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:51.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:51.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:51.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:52.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:52.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:53.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:52.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:53.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:53.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:54.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:54.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:54.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:54.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:55.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:55.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:55.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:55.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:56.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:56.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:57.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:56.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:57.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:57.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:58.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:58.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:58.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:58.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:59.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:18:58.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:18:59.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:18:59.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:00.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:00.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:00.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:00.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:00.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:00.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:01.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:01.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:01.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:01.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:02.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:02.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:02.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:02.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:03.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:03.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:03.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:03.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:04.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:04.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:04.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:04.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:05.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:05.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:05.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:05.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:06.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:06.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:07.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:07.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:07.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:07.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:08.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:08.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:08.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:08.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:09.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:09.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:09.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:09.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:10.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:10.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:10.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:10.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:11.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:10.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:11.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:11.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:11.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:11.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:12.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:12.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:12.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:12.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:13.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:13.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:13.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:13.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:14.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:14.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:14.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:14.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:15.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:15.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:15.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:15.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:16.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:16.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:16.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:16.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:17.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:17.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:17.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:17.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:18.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:18.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:18.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:18.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:19.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:19.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:19.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:19.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:20.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:20.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:20.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:20.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:21.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:21.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:21.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:21.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:22.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:22.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:22.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:22.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:23.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:23.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:24.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:23.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:24.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:24.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:24.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:24.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:25.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:25.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:26.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:26.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:26.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:26.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:27.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:27.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:27.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:27.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:28.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:28.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:28.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:28.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:29.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:28.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:29.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:29.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:29.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:29.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:29.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:29.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:30.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:30.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:30.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:30.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:31.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:31.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:31.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:31.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:32.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:32.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:32.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:32.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:33.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:33.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:33.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:33.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:34.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:34.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:34.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:34.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:35.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:35.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:35.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:35.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:36.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:36.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:37.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:36.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:37.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:37.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:37.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:37.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:38.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:38.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:38.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:38.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:39.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:39.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:39.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:39.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:40.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:40.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:40.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:40.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:41.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:41.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:41.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:41.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:42.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:42.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:43.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:43.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:43.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:43.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:43.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:43.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:44.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:44.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:45.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:44.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:45.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:45.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:46.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:46.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:46.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:46.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:47.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:47.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:47.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:47.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:48.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:48.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:48.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:48.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:48.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:48.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:49.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:49.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:50.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:50.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:50.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:50.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:51.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:51.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:51.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:51.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:52.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:52.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:52.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:52.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:53.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:53.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:53.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:53.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:54.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:54.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:54.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:54.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:55.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:55.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:55.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:55.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:56.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:56.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:57.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:57.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:57.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:57.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:58.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:58.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:58.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:58.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:59.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:19:59.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:19:59.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:19:59.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:00.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:00.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:00.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:01.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:01.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:01.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:01.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:02.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:02.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:02.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:02.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:03.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:03.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:03.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:03.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:04.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:04.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:04.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:04.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:05.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:05.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:05.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:05.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:06.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:06.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:06.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:06.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:07.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:07.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:07.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:07.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:08.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:08.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:08.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:08.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:09.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:09.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:09.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:09.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:10.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:10.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:10.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:10.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:11.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:11.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:11.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:11.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:12.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:12.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:12.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:12.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:13.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:13.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:13.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:13.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:14.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:14.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:14.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:14.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:15.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:15.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:15.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:15.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:16.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:16.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:16.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:16.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:17.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:17.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:17.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:17.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:18.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:18.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:18.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:18.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:19.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:19.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:19.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:19.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:20.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:20.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:20.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:20.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:21.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:21.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:21.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:21.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:22.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:22.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:22.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:22.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:23.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:23.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:23.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:23.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:24.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:24.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:24.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:24.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:25.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:25.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:25.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:25.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:26.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:26.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:26.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:26.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:27.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:27.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:27.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:27.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:28.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:28.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:28.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:28.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:29.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:29.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:29.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:29.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:30.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:30.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:30.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:30.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:31.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:31.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:31.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:31.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:32.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:32.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:32.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:32.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:33.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:33.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:33.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:33.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:34.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:34.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:34.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:34.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:35.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:35.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:35.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:35.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:36.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:36.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:36.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:36.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:37.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:37.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:37.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:37.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:38.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:38.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:38.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:38.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:39.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:39.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:39.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:39.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:40.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:40.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:40.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:40.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:41.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:41.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:41.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:41.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:42.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:42.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:42.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:42.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:43.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:43.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:43.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:43.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:44.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:44.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:44.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:44.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:45.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:45.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:45.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:45.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:46.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:46.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:46.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:46.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:47.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:47.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:47.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:47.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:48.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:48.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:48.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:48.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:49.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:49.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:49.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:49.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:50.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:50.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:50.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:50.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:51.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:51.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:51.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:51.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:52.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:52.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:52.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:52.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:53.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:53.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:53.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:53.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:54.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:54.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:54.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:54.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:55.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:55.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:55.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:55.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:56.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:56.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:56.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:56.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:57.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:57.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:57.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:57.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:58.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:58.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:58.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:58.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:59.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:20:59.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:20:59.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:20:59.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:00.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:00.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:00.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:00.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:01.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:01.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:01.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:01.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:02.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:02.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:02.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:02.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:03.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:03.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:03.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:03.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:04.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:04.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:04.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:04.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:05.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:05.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:05.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:05.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:06.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:06.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:06.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:06.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:07.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:07.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:07.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:07.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:08.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:08.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:08.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:08.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:09.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:09.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:09.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:09.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:10.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:10.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:10.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:10.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:11.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:11.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:11.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:11.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:12.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:12.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:12.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:12.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:13.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:13.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:13.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:13.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:14.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:14.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:14.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:14.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:15.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:15.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:15.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:15.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:16.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:16.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:16.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:16.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:17.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:17.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:17.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:17.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:18.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:18.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:18.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:18.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:19.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:19.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:19.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:19.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:20.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:20.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:20.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:20.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:21.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:21.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:21.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:21.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:22.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:22.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:22.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:22.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:22.699 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T04:21:22.687+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x7f5fa403c310 msgr2=0x7f5fa41140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-05-20T04:21:23.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:23.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:23.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:23.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:24.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:24.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:24.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:24.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:25.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:25.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:25.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:25.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:26.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:26.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:26.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:26.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:27.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:27.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:27.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:27.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:28.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:28.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:28.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:28.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:29.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:29.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:29.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:29.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:30.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:30.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:30.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:30.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:31.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:31.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:31.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:31.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:32.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:32.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:32.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:32.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:33.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:33.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:33.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:33.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:34.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:34.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:34.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:34.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:35.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:35.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:35.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:35.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:36.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:36.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:36.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:36.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:37.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:37.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:37.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:37.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:38.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:38.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:38.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:38.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:39.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:39.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:39.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:39.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:40.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:40.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:40.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:40.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:41.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:41.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:41.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:41.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:42.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:42.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:42.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:42.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:43.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:43.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:43.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:43.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:44.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:44.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:44.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:44.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:45.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:45.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:45.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:45.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:46.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:46.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:46.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:46.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:47.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:47.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:47.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:47.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:48.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:48.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:48.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:48.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:49.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:49.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:49.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:49.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:50.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:50.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:50.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:50.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:51.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:51.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:51.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:51.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:52.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:52.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:52.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:52.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:53.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:53.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:53.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:53.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:54.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:54.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:54.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:54.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:55.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:55.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:55.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:55.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:56.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:56.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:56.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:56.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:57.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:57.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:57.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:57.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:58.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:58.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:58.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:58.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:59.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:21:59.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:21:59.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:21:59.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:00.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:00.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:00.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:00.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:01.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:01.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:01.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:01.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:02.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:02.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:02.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:02.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:03.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:03.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:03.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:03.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:04.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:04.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:04.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:04.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:05.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:05.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:05.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:05.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:06.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:06.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:06.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:06.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:07.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:07.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:07.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:07.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:08.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:08.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:08.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:08.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:09.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:09.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:09.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:09.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:10.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:10.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:10.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:10.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:11.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:11.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:11.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:11.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:12.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:12.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:12.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:12.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:13.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:13.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:13.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:13.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:14.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:14.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:14.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:14.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:15.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:15.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:15.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:15.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:16.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:16.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:16.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:16.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:17.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:17.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:17.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:17.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:18.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:18.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:18.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:18.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:19.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:19.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:19.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:19.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:20.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:20.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:20.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:20.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:21.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:21.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:21.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:21.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:22.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:22.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:22.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:22.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:23.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:23.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:23.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:23.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:24.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:24.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:24.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:24.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:25.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:25.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:25.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:25.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:26.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:26.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:26.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:26.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:27.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:27.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:27.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:27.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:28.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:28.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:28.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:28.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:29.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:29.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:29.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:29.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:30.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:30.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:30.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:30.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:31.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:31.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:31.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:31.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:32.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:32.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:32.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:32.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:33.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:33.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:33.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:33.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:34.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:34.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:34.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:34.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:35.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:35.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:35.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:35.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:36.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:36.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:36.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:36.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:37.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:37.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:37.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:37.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:38.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:38.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:38.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:38.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:39.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:39.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:39.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:39.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:40.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:40.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:40.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:40.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:41.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:41.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:41.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:41.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:42.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:42.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:43.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:43.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:43.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:43.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:44.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:44.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:44.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:44.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:45.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:45.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:45.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:45.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:46.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:46.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:46.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:46.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:47.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:47.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:47.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:47.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:48.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:48.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:48.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:48.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:49.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:49.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:49.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:49.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:50.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:50.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:50.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:50.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:51.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:50.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:51.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:51.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:51.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:51.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:52.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:52.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:53.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:53.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:53.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:53.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:53.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:53.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:54.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:54.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:54.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:54.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:55.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:55.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:55.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:55.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:56.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:56.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:56.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:56.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:57.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:57.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:57.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:57.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:58.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:58.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:58.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:58.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:59.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:22:59.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:22:59.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:22:59.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:00.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:00.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:00.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:00.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:01.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:01.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:01.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:01.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:02.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:02.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:02.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:02.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:03.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:03.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:03.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:03.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:04.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:04.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:04.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:04.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:05.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:05.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:05.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:05.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:06.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:06.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:06.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:06.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:07.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:07.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:07.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:07.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:08.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:08.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:08.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:08.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:09.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:09.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:09.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:09.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:10.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:10.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:10.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:10.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:11.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:11.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:11.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:11.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:12.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:12.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:12.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:12.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:13.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:13.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:13.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:13.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:14.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:14.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:14.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:14.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:15.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:15.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:15.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:15.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:16.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:16.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:16.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:16.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:17.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:17.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:17.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:17.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:18.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:18.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:18.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:18.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:19.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:19.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:19.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:19.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:20.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:20.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:20.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:20.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:21.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:21.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:21.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:21.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:22.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:22.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:22.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:22.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:23.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:23.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:23.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:23.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:24.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:24.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:24.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:24.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:25.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:25.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:25.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:25.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:26.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:26.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:26.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:26.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:27.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:27.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:27.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:27.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:28.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:28.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:28.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:28.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:29.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:29.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:29.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:29.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:30.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:30.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:30.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:30.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:31.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:31.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:31.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:31.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:32.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:32.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:32.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:32.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:33.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:33.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:33.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:33.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:34.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:34.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:34.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:34.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:35.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:35.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:35.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:35.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:36.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:36.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:36.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:36.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:37.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:37.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:37.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:37.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:38.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:38.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:38.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:38.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:39.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:39.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:39.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:39.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:40.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:40.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:40.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:40.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:41.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:41.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:41.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:41.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:42.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:42.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:42.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:42.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:43.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:43.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:43.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:43.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:44.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:44.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:44.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:44.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:45.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:45.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:45.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:45.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:46.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:46.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:46.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:46.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:47.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:47.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:47.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:47.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:48.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:48.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:48.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:48.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:49.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:49.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:49.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:49.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:50.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:50.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:50.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:50.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:51.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:51.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:51.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:51.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:52.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:52.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:52.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:52.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:53.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:53.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:53.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:53.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:54.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:54.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:54.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:54.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:55.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:55.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:55.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:55.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:56.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:56.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:56.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:56.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:57.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:57.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:57.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:57.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:58.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:58.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:58.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:58.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:59.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:23:59.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:23:59.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:23:59.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:00.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:00.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:00.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:00.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:01.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:01.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:01.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:01.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:02.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:02.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:02.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:02.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:03.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:03.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:03.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:03.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:04.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:04.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:04.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:04.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:05.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:05.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:05.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:05.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:06.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:06.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:06.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:06.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:07.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:07.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:07.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:07.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:08.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:08.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:08.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:08.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:09.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:09.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:09.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:09.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:10.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:10.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:10.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:10.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:11.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:11.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:11.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:11.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:12.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:12.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:12.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:12.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:13.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:13.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:13.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:13.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:14.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:14.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:14.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:14.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:15.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:15.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:16.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:16.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:16.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:16.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:17.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:17.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:17.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:17.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:18.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:17.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:18.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:18.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:19.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:19.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:19.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:19.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:20.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:20.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:20.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:20.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:21.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:21.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:21.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:21.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:22.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:22.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:22.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:22.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:23.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:23.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:23.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:23.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:24.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:24.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:24.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:24.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:25.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:25.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:25.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:25.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:26.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:26.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:26.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:26.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:26.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:26.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:27.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:27.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:27.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:27.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:28.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:28.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:29.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:28.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:29.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:29.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:30.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:30.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:30.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:30.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:31.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:31.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:31.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:31.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:32.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:32.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:32.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:32.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:33.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:33.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:33.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:33.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:34.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:34.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:34.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:34.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:35.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:35.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:35.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:35.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:36.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:36.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:36.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:36.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:37.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:37.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:37.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:37.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:38.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:38.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:38.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:38.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:38.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:38.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:39.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:39.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:39.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:39.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:40.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:40.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:41.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:40.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:41.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:41.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:42.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:42.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:42.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:42.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:43.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:43.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:43.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:43.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:44.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:44.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:44.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:44.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:45.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:45.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:45.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:45.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:46.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:46.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:46.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:46.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:47.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:47.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:47.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:47.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:48.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:48.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:48.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:48.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:49.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:49.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:49.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:49.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:50.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:50.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:50.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:50.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:51.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:51.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:51.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:51.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:52.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:52.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:52.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:52.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:53.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:53.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:53.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:53.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:54.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:54.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:54.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:54.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:55.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:55.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:55.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:55.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:56.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:56.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:56.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:56.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:57.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:57.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:57.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:57.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:58.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:58.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:58.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:58.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:59.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:24:59.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:24:59.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:24:59.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:00.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:00.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:00.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:00.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:01.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:01.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:01.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:01.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:02.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:02.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:02.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:02.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:03.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:03.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:03.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:03.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:04.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:04.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:04.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:04.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:05.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:05.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:05.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:05.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:06.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:06.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:06.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:06.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:07.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:07.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:07.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:07.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:08.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:08.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:08.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:08.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:09.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:09.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:09.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:09.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:10.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:10.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:10.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:10.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:11.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:11.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:11.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:11.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:12.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:12.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:12.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:12.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:13.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:13.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:13.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:13.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:14.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:14.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:14.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:14.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:15.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:15.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:15.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:15.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:16.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:16.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:16.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:16.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:17.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:17.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:17.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:17.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:18.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:18.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:18.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:18.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:19.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:19.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:19.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:19.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:20.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:20.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:20.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:20.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:21.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:21.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:21.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:21.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:22.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:22.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:22.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:22.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:23.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:23.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:23.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:23.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:24.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:24.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:24.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:24.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:25.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:25.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:25.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:25.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:26.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:26.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:26.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:26.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:27.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:27.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:27.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:27.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:28.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:28.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:28.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:28.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:29.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:29.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:29.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:29.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:30.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:30.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:30.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:30.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:31.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:31.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:31.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:31.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:32.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:32.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:32.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:32.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:33.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:33.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:33.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:33.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:34.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:34.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:34.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:34.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:35.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:35.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:35.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:35.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:36.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:36.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:36.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:36.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:37.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:37.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:37.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:37.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:38.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:38.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:38.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:38.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:39.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:39.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:39.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:39.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:40.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:40.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:40.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:40.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:41.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:41.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:41.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:41.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:42.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:42.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:42.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:42.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:43.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:43.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:43.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:43.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:44.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:44.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:44.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:44.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:45.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:45.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:45.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:45.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:46.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:46.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:46.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:46.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:47.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:47.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:47.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:47.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:48.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:48.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:48.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:48.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:49.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:49.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:49.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:49.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:50.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:50.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:50.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:50.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:51.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:51.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:51.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:51.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:52.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:52.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:52.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:52.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:53.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:53.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:53.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:53.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:54.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:54.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:54.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:54.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:55.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:55.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:55.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:55.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:56.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:56.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:56.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:56.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:57.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:57.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:57.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:57.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:58.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:58.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:58.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:58.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:59.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:25:59.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:25:59.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:25:59.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:00.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:00.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:00.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:00.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:01.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:01.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:01.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:01.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:02.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:02.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:02.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:02.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:03.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:03.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:03.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:03.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:04.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:04.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:04.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:04.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:05.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:05.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:05.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:05.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:06.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:06.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:06.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:06.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:07.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:07.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:07.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:07.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:08.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:08.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:08.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:08.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:09.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:09.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:09.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:09.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:10.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:10.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:10.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:10.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:11.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:11.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:11.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:11.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:12.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:12.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:12.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:12.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:13.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:13.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:13.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:13.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:14.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:14.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:14.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:14.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:15.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:15.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:15.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:15.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:16.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:16.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:16.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:16.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:17.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:17.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:17.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:17.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:18.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:18.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:18.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:18.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:19.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:19.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:19.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:19.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:20.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:20.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:20.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:20.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:21.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:21.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:21.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:21.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:22.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:22.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:22.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:22.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:23.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:23.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:23.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:23.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:24.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:24.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:24.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:24.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:25.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:25.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:25.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:25.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:26.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:26.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:26.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:26.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:27.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:27.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:27.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:27.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:28.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:28.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:28.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:28.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:29.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:29.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:29.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:29.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:30.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:30.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:30.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:30.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:31.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:31.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:31.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:31.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:32.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:32.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:32.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:32.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:33.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:33.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:33.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:33.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:34.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:34.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:34.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:34.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:35.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:35.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:35.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:35.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:36.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:36.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:36.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:36.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:37.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:37.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:37.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:37.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:38.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:38.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:38.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:38.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:39.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:39.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:39.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:39.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:40.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:40.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:40.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:40.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:41.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:41.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:41.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:41.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:42.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:42.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:42.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:42.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:43.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:43.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:43.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:43.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:44.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:44.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:44.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:44.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:45.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:45.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:45.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:45.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:46.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:46.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:46.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:46.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:47.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:47.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:47.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:47.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:48.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:48.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:48.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:48.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:49.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:49.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:49.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:49.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:49.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:49.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:50.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:50.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:51.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:51.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:51.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:51.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:52.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:52.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:52.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:52.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:52.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:52.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:53.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:53.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:53.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:53.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:54.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:54.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:54.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:54.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:55.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:55.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:55.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:55.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:56.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:56.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:56.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:56.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:57.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:57.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:57.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:57.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:58.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:58.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:58.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:58.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:59.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:26:59.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:26:59.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:26:59.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:00.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:00.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:00.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:00.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:01.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:01.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:01.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:01.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:02.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:02.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:02.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:02.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:03.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:03.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:03.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:03.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:04.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:04.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:04.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:04.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:05.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:05.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:05.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:05.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:06.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:06.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:06.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:06.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:07.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:07.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:07.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:07.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:08.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:08.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:08.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:08.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:09.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:09.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:09.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:09.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:10.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:10.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:10.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:10.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:11.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:11.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:11.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:11.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:12.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:12.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:12.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:12.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:13.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:13.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:13.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:13.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:14.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:14.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:14.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:14.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:15.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:15.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:15.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:15.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:16.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:16.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:17.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:17.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:17.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:17.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:18.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:17.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:18.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:18.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:19.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:19.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:19.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:19.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:20.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:20.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:20.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:20.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:21.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:21.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:21.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:21.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:22.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:22.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:22.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:22.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:23.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:23.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:23.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:23.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:24.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:24.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:24.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:24.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:25.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:25.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:25.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:25.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:26.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:26.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:26.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:26.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:27.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:27.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:27.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:27.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:28.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:28.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:28.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:28.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:29.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:29.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:29.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:29.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:30.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:30.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:30.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:30.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:31.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:31.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:31.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:31.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:32.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:32.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:32.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:32.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:33.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:33.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:33.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:33.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:34.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:34.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:34.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:34.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:35.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:35.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:35.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:35.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:36.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:36.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:36.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:36.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:37.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:37.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:37.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:37.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:38.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:38.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:38.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:38.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:39.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:39.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:39.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:39.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:40.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:40.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:40.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:40.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:41.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:41.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:41.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:41.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:42.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:42.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:42.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:42.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:43.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:43.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:43.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:43.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:44.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:44.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:44.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:44.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:45.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:45.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:45.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:45.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:46.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:46.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:46.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:46.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:47.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:47.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:47.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:47.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:48.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:48.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:48.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:48.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:49.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:49.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:49.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:49.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:50.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:50.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:50.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:50.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:51.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:51.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:51.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:51.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:52.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:52.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:52.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:52.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:53.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:53.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:53.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:53.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:54.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:54.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:54.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:54.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:55.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:55.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:55.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:55.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:56.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:56.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:56.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:56.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:57.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:57.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:57.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:57.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:58.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:58.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:58.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:58.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:59.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:27:59.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:27:59.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:27:59.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:00.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:00.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:00.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:00.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:01.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:01.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:01.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:01.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:02.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:02.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:02.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:02.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:03.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:03.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:03.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:03.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:04.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:04.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:04.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:04.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:05.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:05.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:05.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:05.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:06.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:06.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:06.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:06.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:07.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:07.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:07.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:07.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:08.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:08.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:08.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:08.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:09.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:09.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:09.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:09.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:10.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:10.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:10.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:10.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:11.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:11.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:11.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:11.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:12.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:12.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:12.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:12.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:13.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:13.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:13.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:13.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:14.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:14.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:14.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:14.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:15.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:15.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:15.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:15.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:16.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:16.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:16.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:16.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:17.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:17.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:17.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:17.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:18.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:18.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:18.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:18.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:19.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:19.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:19.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:19.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:20.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:20.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:20.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:20.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:21.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:21.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:21.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:21.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:22.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:22.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:22.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:22.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:23.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:23.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:23.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:23.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:24.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:24.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:24.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:24.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:25.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:25.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:25.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:25.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:26.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:26.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:26.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:26.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:27.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:27.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:27.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:27.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:28.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:28.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:28.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:28.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:29.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:29.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:29.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:29.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:30.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:30.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:30.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:30.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:31.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:31.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:31.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:31.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:32.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:32.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:32.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:32.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:33.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:33.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:33.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:33.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:34.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:34.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:34.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:34.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:35.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:35.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:35.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:35.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:36.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:36.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:36.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:36.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:37.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:37.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:37.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:37.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:38.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:38.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:38.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:38.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:39.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:39.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:39.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:39.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:40.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:40.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:40.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:40.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:41.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:41.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:41.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:41.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:42.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:42.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:42.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:42.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:43.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:43.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:43.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:43.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:44.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:44.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:44.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:44.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:45.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:45.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:45.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:45.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:46.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:46.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:46.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:46.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:47.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:47.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:47.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:47.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:48.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:48.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:48.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:48.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:49.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:49.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:50.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:50.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:50.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:50.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:50.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:50.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:51.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:51.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:51.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:51.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:52.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:52.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:52.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:52.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:53.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:53.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:53.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:53.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:54.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:54.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:54.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:54.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:55.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:55.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:55.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:55.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:56.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:56.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:56.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:56.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:57.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:57.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:57.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:57.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:58.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:58.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:58.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:58.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:59.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:28:59.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:28:59.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:28:59.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:00.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:00.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:00.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:00.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:01.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:01.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:02.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:01.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:02.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:02.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:02.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:02.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:03.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:03.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:04.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:03.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:04.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:04.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:05.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:05.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:05.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:05.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:06.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:06.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:06.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:06.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:07.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:07.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:07.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:07.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:07.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:07.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:08.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:08.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:08.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:08.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:09.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:09.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:10.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:10.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:10.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:10.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:11.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:11.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:11.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:11.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:12.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:12.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:12.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:12.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:13.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:13.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:13.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:13.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:14.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:14.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:14.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:14.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:15.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:15.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:15.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:15.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:16.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:16.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:16.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:16.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:17.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:17.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:17.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:17.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:18.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:18.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:18.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:18.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:19.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:19.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:19.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:19.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:20.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:20.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:20.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:20.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:21.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:21.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:21.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:21.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:22.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:22.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:22.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:22.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:23.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:23.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:23.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:23.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:24.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:24.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:24.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:24.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:25.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:25.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:25.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:25.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:26.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:26.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:26.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:26.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:27.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:27.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:27.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:27.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:28.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:28.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:28.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:28.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:28.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:28.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:29.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:29.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:29.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:29.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:30.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:30.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:31.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:31.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:31.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:31.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:32.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:32.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:32.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:32.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:33.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:33.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:33.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:33.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:34.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:34.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:34.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:34.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:35.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:35.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:35.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:36.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:36.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:36.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:36.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:37.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:37.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:37.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:37.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:38.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:38.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:38.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:38.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:39.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:39.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:39.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:39.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:40.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:40.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:40.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:40.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:41.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:41.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:41.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:41.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:42.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:42.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:42.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:42.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:43.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:43.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:43.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:43.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:44.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:44.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:44.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:44.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:45.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:45.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:45.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:45.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:46.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:46.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:46.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:46.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:47.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:47.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:47.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:47.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:48.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:48.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:48.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:48.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:49.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:49.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:49.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:49.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:50.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:50.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:50.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:50.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:51.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:51.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:51.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:51.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:52.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:52.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:52.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:52.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:53.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:53.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:53.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:53.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:54.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:54.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:54.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:54.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:55.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:55.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:55.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:55.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:56.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:56.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:56.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:56.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:57.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:57.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:57.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:57.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:58.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:58.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:58.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:58.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:59.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:29:59.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:29:59.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:29:59.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:00.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:00.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:00.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:00.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:01.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:01.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:01.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:01.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:02.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:02.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:02.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:02.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:03.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:03.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:03.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:03.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:04.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:04.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:04.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:04.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:05.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:05.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:05.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:05.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:06.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:06.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:06.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:06.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:07.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:07.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:07.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:07.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:08.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:08.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:08.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:08.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:09.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:09.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:09.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:09.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:10.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:10.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:10.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:10.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:11.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:11.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:11.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:11.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:12.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:12.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:12.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:12.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:13.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:13.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:13.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:13.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:14.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:14.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:14.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:14.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:15.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:15.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:15.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:15.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:16.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:16.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:16.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:16.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:17.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:17.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:17.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:17.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:18.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:18.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:18.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:18.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:19.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:19.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:19.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:19.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:20.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:20.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:20.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:20.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:21.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:21.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:21.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:21.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:22.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:22.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:22.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:22.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:23.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:23.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:23.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:23.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:24.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:24.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:24.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:24.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:25.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:25.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:25.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:25.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:26.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:26.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:26.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:26.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:27.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:27.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:27.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:27.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:28.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:28.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:28.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:28.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:29.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:29.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:29.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:29.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:30.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:30.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:30.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:30.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:31.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:31.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:31.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:31.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:32.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:32.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:32.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:32.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:33.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:33.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:33.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:33.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:34.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:34.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:34.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:34.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:35.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:35.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:35.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:35.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:36.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:36.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:36.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:36.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:37.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:37.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:37.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:37.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:38.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:38.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:38.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:38.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:39.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:39.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:39.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:39.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:40.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:40.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:40.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:40.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:41.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:41.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:41.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:41.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:42.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:42.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:42.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:42.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:43.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:43.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:43.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:43.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:44.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:44.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:44.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:44.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:45.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:45.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:45.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:45.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:46.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:46.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:46.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:46.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:47.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:47.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:47.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:47.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:48.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:48.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:48.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:48.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:49.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:49.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:49.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:49.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:50.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:50.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:50.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:50.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:51.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:51.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:51.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:51.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:52.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:52.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:52.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:52.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:53.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:53.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:53.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:53.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:54.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:54.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:54.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:54.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:55.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:55.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:55.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:55.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:56.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:56.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:56.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:56.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:57.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:57.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:57.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:57.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:58.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:58.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:58.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:58.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:59.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:30:59.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:30:59.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:30:59.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:00.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:00.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:00.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:00.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:01.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:01.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:01.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:01.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:02.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:02.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:02.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:02.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:03.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:03.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:03.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:03.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:04.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:04.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:04.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:04.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:05.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:05.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:06.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:06.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:06.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:06.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:07.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:06.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:07.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:07.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:08.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:08.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:08.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:08.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:09.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:09.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:09.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:09.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:10.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:10.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:10.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:10.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:11.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:11.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:11.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:11.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:12.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:12.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:12.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:12.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:13.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:13.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:13.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:13.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:14.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:14.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:14.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:14.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:15.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:15.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:15.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:15.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:16.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:16.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:16.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:16.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:17.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:17.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:17.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:17.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:18.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:18.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:18.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:18.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:19.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:19.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:19.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:19.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:20.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:20.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:20.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:20.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:21.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:21.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:21.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:21.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:22.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:22.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:22.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:22.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:23.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:23.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:23.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:23.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:24.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:24.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:24.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:24.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:25.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:25.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:25.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:25.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:26.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:26.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:26.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:26.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:27.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:27.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:27.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:27.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:28.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:28.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:28.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:28.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:29.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:29.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:29.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:29.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:30.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:30.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:30.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:30.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:31.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:31.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:31.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:31.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:32.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:32.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:32.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:32.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:33.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:33.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:33.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:33.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:34.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:34.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:34.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:34.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:35.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:35.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:35.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:35.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:36.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:36.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:36.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:36.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:37.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:37.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:37.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:37.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:38.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:38.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:38.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:38.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:39.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:39.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:39.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:39.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:40.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:40.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:40.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:40.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:41.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:41.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:41.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:41.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:42.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:42.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:42.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:42.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:43.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:43.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:43.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:43.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:44.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:44.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:44.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:44.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:45.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:45.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:45.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:45.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:46.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:46.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:46.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:46.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:47.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:47.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:47.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:47.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:48.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:48.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:48.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:48.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:49.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:49.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:49.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:49.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:50.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:50.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:50.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:50.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:51.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:51.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:51.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:51.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:52.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:52.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:52.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:52.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:53.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:53.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:53.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:53.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:54.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:54.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:54.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:54.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:55.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:55.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:55.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:55.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:56.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:56.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:56.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:56.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:57.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:57.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:57.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:57.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:58.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:58.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:58.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:58.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:59.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:31:59.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:31:59.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:31:59.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:00.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:00.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:00.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:00.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:01.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:01.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:01.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:01.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:02.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:02.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:02.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:02.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:03.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:03.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:03.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:03.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:04.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:04.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:04.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:04.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:05.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:05.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:05.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:05.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:06.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:06.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:07.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:07.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:07.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:07.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:08.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:08.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:08.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:08.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:09.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:09.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:09.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:09.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:10.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:10.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:10.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:10.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:11.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:11.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:11.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:11.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:12.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:12.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:12.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:12.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:13.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:12.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:13.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:13.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:13.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:13.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:14.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:14.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:14.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:14.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:15.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:15.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:16.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:16.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:16.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:16.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:16.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:16.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:16.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:16.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:17.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:17.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:17.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:17.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:18.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:18.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:19.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:19.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:19.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:19.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:19.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:19.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:20.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:20.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:21.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:21.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:21.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:21.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:22.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:22.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:22.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:22.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:23.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:23.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:23.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:23.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:24.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:24.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:24.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:24.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:24.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:24.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:25.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:25.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:26.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:25.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:26.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:26.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:26.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:26.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:27.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:27.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:27.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:27.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:28.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:28.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:28.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:28.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:29.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:29.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:29.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:29.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:30.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:30.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:30.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:30.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:31.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:31.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:32.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:32.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:32.791 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T04:32:32.779+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:3300/0,v1:172.21.15.163:6789/0] conn(0x5561d64d88e0 msgr2=0x7f5fa403f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T04:32:33.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:33.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:33.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:33.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:34.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:34.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:34.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:34.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:35.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:35.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:35.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:35.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:35.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:35.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:36.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:36.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:37.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:37.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:37.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:37.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:38.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:38.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:38.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:38.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:39.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:39.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:39.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:39.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:39.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:39.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:40.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:40.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:41.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:41.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:41.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:41.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:41.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:41.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:42.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:42.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:43.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:43.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:43.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:43.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:44.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:44.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:44.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:44.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:45.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:45.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:45.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:45.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:46.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:46.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:46.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:46.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:47.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:47.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:47.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:47.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:47.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:47.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:48.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:48.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:49.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:48.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:49.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:48.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:49.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:49.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:50.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:50.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:50.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:50.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:51.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:51.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:51.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:51.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:52.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:52.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:52.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:52.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:53.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:53.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:53.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:53.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:54.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:54.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:55.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:54.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:55.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:55.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:55.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:55.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:56.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:56.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:57.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:56.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:57.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:57.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:57.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:57.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:58.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:58.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:58.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:58.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:59.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:32:59.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:32:59.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:32:59.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:00.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:00.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:00.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:00.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:01.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:01.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:01.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:01.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:02.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:02.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:02.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:02.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:03.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:03.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:03.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:03.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:04.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:04.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:04.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:04.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:05.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:05.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:05.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:05.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:06.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:06.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:06.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:06.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:07.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:07.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:07.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:07.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:08.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:08.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:08.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:08.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:09.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:09.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:09.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:09.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:10.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:10.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:10.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:10.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:11.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:11.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:11.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:11.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:12.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:12.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:12.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:12.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:13.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:13.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:13.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:13.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:14.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:14.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:14.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:14.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:15.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:15.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:15.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:15.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:16.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:16.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:16.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:16.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:17.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:17.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:17.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:17.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:18.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:18.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:18.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:18.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:19.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:19.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:19.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:19.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:20.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:20.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:20.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:20.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:21.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:21.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:21.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:21.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:22.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:22.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:22.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:22.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:23.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:23.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:23.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:23.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:24.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:24.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:24.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:24.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:25.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:25.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:25.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:25.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:26.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:26.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:26.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:26.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:27.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:27.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:27.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:27.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:28.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:28.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:28.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:28.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:29.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:29.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:29.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:29.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:30.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:30.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:30.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:30.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:31.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:31.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:31.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:31.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:32.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:32.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:32.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:32.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:33.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:33.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:33.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:33.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:34.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:34.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:34.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:34.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:35.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:35.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:35.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:35.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:36.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:36.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:36.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:36.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:37.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:37.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:37.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:37.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:38.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:38.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:38.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:38.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:39.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:39.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:39.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:39.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:40.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:40.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:40.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:40.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:41.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:41.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:42.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:41.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:42.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:42.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:42.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:42.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:43.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:43.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:44.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:44.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:44.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:44.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:45.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:45.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:45.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:45.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:45.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:45.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:46.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:46.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:46.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:46.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:47.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:47.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:47.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:47.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:48.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:48.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:48.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:48.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:49.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:49.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:49.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:49.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:50.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:50.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:50.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:50.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:51.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:51.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:51.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:51.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:52.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:52.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:52.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:52.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:53.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:53.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:53.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:53.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:54.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:54.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:54.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:54.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:55.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:55.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:55.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:55.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:56.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:56.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:56.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:56.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:57.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:57.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:57.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:57.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:58.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:58.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:58.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:58.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:59.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:33:59.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:33:59.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:33:59.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:00.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:00.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:00.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:00.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:01.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:01.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:01.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:01.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:02.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:02.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:02.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:02.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:03.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:03.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:03.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:03.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:04.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:04.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:04.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:04.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:05.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:05.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:05.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:05.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:06.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:06.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:06.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:06.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:07.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:07.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:07.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:07.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:08.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:08.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:08.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:08.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:09.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:09.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:09.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:09.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:10.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:10.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:10.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:10.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:11.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:11.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:11.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:11.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:12.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:12.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:12.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:12.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:13.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:13.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:13.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:13.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:14.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:14.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:14.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:14.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:15.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:15.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:15.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:15.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:16.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:16.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:16.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:16.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:17.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:17.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:17.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:17.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:18.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:18.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:18.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:18.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:19.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:19.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:19.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:19.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:20.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:20.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:20.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:20.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:21.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:21.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:21.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:21.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:22.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:22.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:22.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:22.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:23.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:23.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:23.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:23.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:24.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:24.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:24.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:24.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:25.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:25.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:25.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:25.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:26.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:26.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:26.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:26.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:27.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:27.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:27.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:27.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:28.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:28.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:28.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:28.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:29.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:29.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:29.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:29.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:30.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:30.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:30.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:30.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:31.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:31.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:31.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:31.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:32.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:32.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:32.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:32.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:33.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:33.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:33.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:33.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:34.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:34.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:34.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:34.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:35.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:35.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:35.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:35.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:36.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:36.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:36.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:36.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:37.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:37.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:37.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:37.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:38.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:38.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:38.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:38.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:39.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:39.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:39.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:39.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:40.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:40.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:40.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:40.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:41.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:41.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:41.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:41.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:42.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:42.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:42.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:42.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:43.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:43.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:43.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:43.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:44.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:44.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:44.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:44.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:45.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:45.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:45.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:45.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:46.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:46.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:46.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:46.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:47.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:47.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:47.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:47.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:48.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:48.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:48.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:48.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:49.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:49.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:49.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:49.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:50.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:50.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:50.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:50.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:51.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:51.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:51.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:51.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:52.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:52.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:52.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:52.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:53.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:53.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:53.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:53.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:54.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:54.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:54.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:54.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:55.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:55.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:55.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:55.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:56.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:56.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:56.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:56.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:57.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:57.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:57.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:57.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:58.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:58.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:58.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:58.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:59.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:34:59.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:34:59.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:34:59.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:00.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:00.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:00.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:00.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:01.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:01.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:01.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:01.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:02.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:02.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:02.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:02.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:03.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:03.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:03.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:03.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:04.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:04.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:04.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:04.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:05.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:05.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:05.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:05.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:06.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:06.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:06.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:06.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:07.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:07.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:07.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:07.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:08.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:08.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:08.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:08.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:09.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:09.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:09.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:09.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:10.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:10.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:10.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:10.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:11.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:11.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:11.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:11.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:12.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:12.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:12.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:12.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:13.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:13.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:13.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:13.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:14.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:14.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:14.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:14.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:15.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:15.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:15.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:15.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:16.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:16.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:16.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:16.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:17.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:17.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:17.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:17.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:18.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:18.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:18.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:18.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:19.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:19.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:19.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:19.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:20.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:20.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:20.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:20.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:21.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:21.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:21.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:21.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:22.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:22.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:22.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:22.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:23.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:23.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:23.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:23.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:24.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:24.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:24.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:24.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:25.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:25.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:25.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:25.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:26.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:26.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:26.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:26.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:27.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:27.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:27.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:27.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:28.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:28.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:28.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:28.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:29.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:29.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:29.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:29.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:30.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:30.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:30.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:30.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:31.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:31.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:31.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:31.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:32.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:32.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:32.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:32.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:33.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:33.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:33.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:33.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:34.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:34.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:34.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:34.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:35.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:35.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:35.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:35.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:36.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:36.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:36.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:36.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:37.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:37.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:37.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:37.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:38.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:38.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:38.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:38.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:39.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:39.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:39.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:39.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:40.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:40.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:40.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:40.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:41.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:41.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:41.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:41.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:42.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:42.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:42.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:42.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:43.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:43.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:43.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:43.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:44.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:44.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:44.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:44.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:45.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:45.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:45.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:45.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:46.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:46.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:46.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:46.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:47.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:47.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:47.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:47.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:48.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:48.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:48.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:48.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:49.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:49.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:50.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:50.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:50.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:50.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:51.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:51.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:51.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:51.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:52.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:52.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:52.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:52.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:53.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:53.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:53.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:53.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:54.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:54.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:54.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:54.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:55.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:55.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:55.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:55.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:56.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:56.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:56.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:56.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:57.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:57.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:57.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:57.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:57.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:57.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:58.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:58.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:58.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:58.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:59.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:35:59.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:35:59.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:35:59.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:00.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:00.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:00.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:00.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:01.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:01.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:01.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:01.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:02.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:02.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:02.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:02.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:03.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:03.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:03.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:03.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:04.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:04.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:04.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:04.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:05.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:05.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:05.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:05.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:06.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:06.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:06.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:06.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:07.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:07.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:07.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:07.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:08.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:08.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:08.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:08.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:09.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:09.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:09.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:09.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:10.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:10.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:10.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:10.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:11.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:11.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:11.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:11.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:12.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:12.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:12.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:12.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:13.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:13.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:13.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:13.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:14.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:14.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:14.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:14.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:15.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:15.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:15.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:15.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:16.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:16.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:16.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:16.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:17.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:17.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:17.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:17.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:18.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:18.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:18.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:18.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:19.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:19.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:19.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:19.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:20.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:20.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:21.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:20.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:21.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:21.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:22.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:22.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:22.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:22.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:23.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:23.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:23.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:23.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:24.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:24.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:25.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:24.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:25.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:25.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:25.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:25.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:26.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:26.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:26.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:26.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:27.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:27.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:27.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:27.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:28.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:28.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:29.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:29.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:29.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:29.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:29.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:29.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:30.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:30.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:31.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:31.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:31.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:31.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:32.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:32.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:32.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:32.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:33.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:33.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:33.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:33.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:34.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:34.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:34.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:34.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:35.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:35.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:35.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:35.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:36.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:36.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:36.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:36.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:37.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:37.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:37.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:37.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:38.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:38.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:38.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:38.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:39.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:39.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:39.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:39.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:40.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:40.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:40.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:40.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:41.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:41.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:41.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:41.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:42.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:42.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:42.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:42.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:43.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:43.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:43.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:43.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:43.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:43.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:44.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:44.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:45.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:45.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:45.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:45.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:46.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:46.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:46.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:46.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:47.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:47.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:47.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:47.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:48.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:48.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:48.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:48.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:49.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:49.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:49.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:49.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:50.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:50.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:50.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:50.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:51.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:51.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:51.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:51.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:52.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:52.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:52.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:52.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:53.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:53.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:53.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:53.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:54.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:54.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:54.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:54.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:54.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:54.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:55.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:55.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:55.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:55.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:56.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:56.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:56.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:56.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:57.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:57.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:57.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:57.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:58.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:58.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:58.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:58.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:59.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:36:59.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:36:59.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:36:59.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:00.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:00.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:00.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:00.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:01.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:01.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:01.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:01.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:02.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:02.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:03.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:03.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:03.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:03.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:04.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:04.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:04.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:04.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:05.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:05.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:05.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:05.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:06.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:06.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:06.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:06.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:06.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:06.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:07.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:07.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:07.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:07.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:08.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:08.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:08.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:08.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:09.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:09.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:09.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:09.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:10.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:10.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:10.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:10.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:11.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:11.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:11.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:11.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:12.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:12.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:12.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:12.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:13.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:13.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:13.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:13.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:14.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:14.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:14.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:14.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:15.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:15.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:15.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:15.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:16.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:16.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:16.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:16.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:17.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:17.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:17.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:17.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:18.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:18.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:18.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:18.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:18.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:18.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:19.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:19.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:19.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:19.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:20.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:20.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:20.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:20.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:21.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:21.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:21.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:21.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:22.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:22.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:22.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:22.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:23.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:23.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:24.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:23.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:24.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:24.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:25.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:25.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:26.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:25.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:26.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:26.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:27.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:27.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:27.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:27.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:28.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:28.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:28.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:28.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:29.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:29.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:29.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:29.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:30.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:30.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:30.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:30.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:31.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:31.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:31.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:31.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:32.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:32.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:32.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:32.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:33.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:33.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:33.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:33.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:34.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:34.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:34.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:34.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:35.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:35.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:35.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:35.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:36.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:36.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:36.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:36.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:37.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:37.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:37.166 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:37.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:38.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:38.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:38.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:38.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:39.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:39.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:39.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:39.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:40.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:40.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:40.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:40.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:41.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:41.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:41.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:41.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:42.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:42.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:42.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:42.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:43.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:43.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:43.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:43.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:44.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:44.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:44.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:44.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:45.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:45.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:45.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:45.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:46.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:46.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:46.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:46.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:47.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:47.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:47.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:47.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:48.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:48.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:48.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:48.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:49.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:49.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:49.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:49.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:50.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:50.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:50.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:50.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:51.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:51.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:51.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:51.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:52.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:52.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:52.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:52.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:53.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:53.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:53.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:53.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:54.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:54.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:54.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:54.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:55.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:55.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:55.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:55.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:56.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:56.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:56.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:56.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:57.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:57.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:57.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:57.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:58.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:58.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:58.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:58.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:59.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:37:59.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:37:59.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:37:59.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:00.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:00.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:00.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:00.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:01.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:01.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:01.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:01.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:02.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:02.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:02.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:02.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:03.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:03.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:03.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:03.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:04.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:04.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:04.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:04.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:05.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:05.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:05.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:05.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:06.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:06.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:06.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:06.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:06.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:06.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:07.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:07.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:08.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:07.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:08.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:07.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:09.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:09.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:09.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:09.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:10.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:10.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:10.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:10.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:11.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:11.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:11.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:11.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:12.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:12.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:12.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:12.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:13.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:13.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:13.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:13.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:14.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:14.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:14.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:14.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:15.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:15.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:15.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:15.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:16.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:16.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:16.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:16.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:17.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:17.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:17.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:17.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:18.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:18.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:18.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:18.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:19.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:19.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:19.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:19.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:20.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:20.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:20.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:20.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:21.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:21.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:21.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:21.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:22.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:22.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:22.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:22.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:23.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:23.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:23.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:23.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:24.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:24.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:24.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:24.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:25.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:25.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:25.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:25.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:26.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:26.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:26.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:26.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:27.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:27.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:27.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:27.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:28.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:28.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:28.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:28.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:29.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:29.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:29.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:29.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:30.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:30.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:30.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:30.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:31.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:31.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:31.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:31.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:32.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:32.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:32.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:32.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:33.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:33.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:33.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:33.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:34.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:34.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:34.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:34.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:35.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:35.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:35.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:35.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:36.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:36.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:36.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:36.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:37.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:37.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:37.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:37.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:38.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:38.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:38.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:38.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:39.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:39.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:39.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:39.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:40.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:40.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:40.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:40.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:41.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:41.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:41.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:41.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:42.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:42.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:42.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:42.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:43.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:43.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:43.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:43.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:44.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:44.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:44.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:44.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:45.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:45.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:45.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:45.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:46.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:46.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:46.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:46.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:47.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:47.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:47.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:47.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:48.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:48.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:48.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:48.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:49.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:49.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:49.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:49.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:50.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:50.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:50.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:50.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:51.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:51.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:51.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:51.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:52.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:52.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:52.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:52.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:53.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:53.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:53.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:53.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:54.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:54.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:54.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:54.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:54.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:54.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:55.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:55.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:55.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:55.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:56.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:56.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:56.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:56.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:57.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:57.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:57.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:57.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:58.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:58.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:58.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:58.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:59.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:38:59.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:38:59.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:38:59.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:00.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:00.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:00.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:00.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:01.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:01.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:02.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:02.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:02.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:02.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:03.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:03.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:03.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:03.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:04.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:04.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:04.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:04.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:05.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:05.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:05.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:05.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:06.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:06.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:06.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:06.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:07.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:07.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:07.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:07.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:08.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:08.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:08.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:08.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:09.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:09.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:09.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:09.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:10.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:10.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:10.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:10.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:11.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:11.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:11.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:11.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:12.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:12.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:12.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:12.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:13.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:13.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:13.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:13.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:14.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:14.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:14.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:14.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:15.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:15.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:15.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:15.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:16.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:16.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:16.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:16.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:17.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:17.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:17.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:17.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:18.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:18.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:18.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:18.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:19.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:19.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:19.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:19.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:20.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:20.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:20.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:20.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:21.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:21.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:21.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:21.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:22.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:22.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:22.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:22.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:23.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:23.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:23.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:23.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:24.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:24.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:24.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:24.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:25.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:25.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:25.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:25.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:26.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:26.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:26.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:26.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:27.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:27.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:27.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:27.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:28.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:28.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:28.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:28.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:29.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:29.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:29.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:29.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:30.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:30.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:30.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:30.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:31.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:31.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:31.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:31.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:32.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:32.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:32.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:32.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:33.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:33.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:33.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:33.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:34.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:34.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:34.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:34.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:35.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:35.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:35.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:35.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:36.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:36.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:36.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:36.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:37.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:37.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:37.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:37.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:38.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:38.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:38.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:38.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:39.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:39.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:39.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:39.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:40.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:40.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:40.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:40.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:41.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:41.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:41.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:41.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:42.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:42.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:42.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:42.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:43.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:43.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:43.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:43.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:44.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:44.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:44.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:44.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:45.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:45.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:45.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:45.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:46.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:46.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:46.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:46.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:47.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:47.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:47.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:47.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:48.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:48.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:48.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:48.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:49.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:49.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:49.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:49.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:50.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:50.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:50.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:50.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:51.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:51.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:51.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:51.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:52.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:52.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:52.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:52.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:53.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:53.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:53.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:53.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:54.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:54.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:54.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:54.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:55.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:55.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:55.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:55.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:56.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:56.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:56.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:56.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:57.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:57.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:57.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:57.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:58.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:58.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:58.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:58.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:59.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:39:59.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:39:59.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:39:59.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:00.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:00.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:00.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:00.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:01.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:01.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:01.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:01.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:02.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:02.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:02.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:02.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:03.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:03.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:03.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:03.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:04.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:04.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:04.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:04.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:05.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:05.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:05.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:05.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:06.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:06.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:06.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:06.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:07.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:07.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:07.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:07.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:08.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:08.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:08.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:08.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:09.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:09.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:09.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:09.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:10.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:10.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:10.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:10.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:11.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:11.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:11.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:11.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:12.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:12.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:12.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:12.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:13.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:13.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:13.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:13.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:14.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:14.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:14.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:14.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:15.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:15.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:15.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:15.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:16.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:16.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:16.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:16.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:17.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:17.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:17.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:17.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:18.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:18.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:18.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:18.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:19.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:19.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:19.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:19.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:20.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:20.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:20.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:20.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:21.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:21.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:21.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:21.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:22.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:22.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:22.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:22.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:23.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:23.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:23.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:23.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:24.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:24.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:24.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:24.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:25.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:25.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:25.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:25.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:26.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:26.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:26.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:26.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:27.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:27.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:27.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:27.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:28.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:28.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:28.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:28.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:29.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:29.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:29.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:29.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:30.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:30.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:30.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:30.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:31.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:31.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:31.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:31.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:32.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:32.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:32.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:32.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:33.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:33.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:33.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:33.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:34.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:34.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:34.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:34.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:35.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:35.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:35.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:35.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:36.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:36.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:36.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:36.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:37.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:37.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:37.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:37.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:38.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:38.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:38.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:38.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:39.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:39.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:39.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:39.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:40.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:40.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:40.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:40.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:41.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:41.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:41.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:41.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:42.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:42.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:42.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:42.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:43.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:43.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:43.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:43.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:44.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:44.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:44.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:44.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:45.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:45.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:45.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:45.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:46.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:46.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:46.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:46.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:47.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:47.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:47.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:47.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:48.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:48.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:48.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:48.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:49.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:49.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:49.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:49.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:50.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:50.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:50.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:50.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:51.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:51.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:51.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:51.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:52.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:52.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:52.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:52.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:53.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:53.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:53.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:53.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:54.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:54.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:54.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:54.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:55.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:55.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:55.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:55.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:56.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:56.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:56.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:56.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:57.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:57.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:57.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:57.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:58.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:58.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:58.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:58.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:59.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:40:59.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:40:59.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:40:59.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:00.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:00.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:00.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:00.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:01.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:01.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:01.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:01.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:02.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:02.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:02.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:02.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:03.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:03.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:03.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:03.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:04.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:04.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:04.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:04.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:05.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:05.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:05.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:05.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:06.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:06.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:06.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:06.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:07.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:07.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:07.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:07.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:08.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:08.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:08.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:08.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:09.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:09.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:09.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:09.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:10.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:10.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:10.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:10.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:11.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:11.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:11.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:11.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:12.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:12.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:12.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:12.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:13.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:13.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:13.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:13.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:14.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:14.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:14.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:14.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:15.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:15.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:15.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:15.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:16.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:16.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:16.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:16.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:17.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:17.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:17.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:17.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:18.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:18.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:19.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:18.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:19.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:19.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:20.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:20.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:20.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:20.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:21.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:21.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:21.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:21.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:22.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:22.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:22.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:22.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:23.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:23.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:23.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:23.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:24.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:24.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:24.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:24.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:25.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:25.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:25.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:25.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:26.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:26.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:26.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:26.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:27.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:27.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:27.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:27.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:28.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:28.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:28.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:28.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:29.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:29.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:29.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:29.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:30.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:30.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:30.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:30.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:31.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:31.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:31.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:31.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:32.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:32.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:32.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:32.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:33.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:33.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:33.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:33.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:34.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:34.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:34.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:34.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:35.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:35.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:35.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:35.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:36.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:36.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:36.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:36.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:37.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:37.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:37.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:37.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:38.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:38.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:38.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:38.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:39.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:39.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:39.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:39.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:40.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:40.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:40.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:40.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:41.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:41.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:41.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:41.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:42.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:42.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:42.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:42.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:43.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:43.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:43.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:43.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:44.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:44.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:44.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:44.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:45.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:45.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:45.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:45.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:46.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:46.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:46.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:46.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:47.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:47.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:47.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:47.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:48.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:48.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:48.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:48.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:49.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:49.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:49.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:49.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:50.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:50.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:50.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:50.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:51.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:51.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:51.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:51.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:52.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:52.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:52.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:52.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:53.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:53.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:53.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:53.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:54.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:54.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:54.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:54.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:55.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:55.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:55.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:55.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:56.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:56.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:56.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:56.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:57.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:57.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:57.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:57.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:58.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:58.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:58.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:58.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:59.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:41:59.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:41:59.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:41:59.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:00.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:00.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:00.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:00.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:01.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:01.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:01.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:01.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:02.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:02.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:02.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:02.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:03.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:03.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:03.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:03.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:04.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:04.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:04.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:04.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:05.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:05.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:05.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:05.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:06.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:06.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:06.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:06.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:07.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:07.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:07.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:07.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:08.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:08.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:08.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:08.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:09.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:09.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:09.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:09.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:10.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:10.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:10.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:10.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:11.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:11.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:11.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:11.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:12.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:12.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:12.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:12.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:13.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:13.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:13.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:13.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:14.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:14.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:14.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:14.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:15.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:15.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:15.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:15.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:16.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:16.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:16.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:16.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:17.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:17.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:18.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:18.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:18.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:18.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:19.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:19.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:19.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:19.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:20.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:20.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:20.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:20.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:21.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:21.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:21.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:21.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:22.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:22.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:22.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:22.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:23.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:23.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:23.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:23.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:24.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:24.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:24.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:24.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:25.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:25.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:25.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:25.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:26.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:26.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:26.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:26.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:27.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:27.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:27.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:27.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:28.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:28.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:28.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:28.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:29.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:29.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:29.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:29.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:30.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:30.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:30.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:30.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:31.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:31.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:31.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:31.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:32.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:32.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:32.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:32.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:33.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:33.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:33.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:33.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:34.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:34.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:34.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:34.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:35.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:35.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:35.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:35.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:36.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:36.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:36.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:36.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:37.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:37.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:37.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:37.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:38.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:38.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:38.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:38.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:39.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:39.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:39.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:39.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:40.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:40.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:40.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:40.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:41.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:41.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:41.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:41.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:42.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:42.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:42.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:42.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:43.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:43.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:43.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:43.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:44.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:44.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:44.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:44.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:45.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:45.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:45.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:45.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:46.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:46.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:46.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:46.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:47.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:47.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:47.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:47.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:48.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:48.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:48.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:48.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:49.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:49.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:49.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:49.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:50.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:50.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:50.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:50.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:51.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:51.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:51.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:51.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:52.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:52.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:52.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:52.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:53.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:52.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:53.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:53.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:54.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:54.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:54.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:54.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:55.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:55.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:55.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:55.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:56.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:56.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:56.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:56.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:57.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:57.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:57.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:57.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:58.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:58.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:58.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:58.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:59.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:42:59.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:42:59.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:42:59.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:00.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:00.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:00.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:00.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:01.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:01.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:01.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:01.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:02.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:02.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:02.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:02.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:03.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:03.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:03.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:03.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:04.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:04.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:04.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:04.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:05.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:05.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:05.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:05.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:06.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:06.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:06.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:06.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:07.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:07.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:07.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:07.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:07.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:07.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:08.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:08.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:08.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:08.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:09.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:09.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:10.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:10.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:10.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:10.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:11.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:11.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:11.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:11.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:12.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:12.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:12.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:12.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:13.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:13.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:13.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:13.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:14.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:14.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:14.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:14.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:15.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:15.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:15.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:15.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:16.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:16.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:16.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:16.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:17.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:17.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:17.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:17.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:18.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:18.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:18.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:18.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:19.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:19.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:19.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:19.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:20.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:20.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:20.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:20.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:21.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:21.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:21.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:21.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:22.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:22.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:22.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:22.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:23.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:23.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:23.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:23.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:24.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:24.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:24.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:24.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:25.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:25.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:25.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:25.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:26.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:26.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:26.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:26.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:27.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:27.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:27.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:27.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:28.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:28.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:28.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:28.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:29.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:29.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:29.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:29.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:30.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:30.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:30.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:30.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:31.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:31.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:31.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:31.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:32.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:32.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:32.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:32.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:33.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:33.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:33.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:33.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:34.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:34.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:34.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:34.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:35.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:35.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:35.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:35.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:36.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:36.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:36.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:36.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:37.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:37.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:37.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:37.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:38.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:38.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:38.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:38.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:39.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:39.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:39.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:39.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:40.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:40.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:40.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:40.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:41.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:41.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:41.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:41.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:42.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:42.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:42.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:42.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:43.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:43.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:43.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:43.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:44.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:44.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:44.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:44.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:45.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:45.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:45.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:45.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:46.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:46.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:46.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:46.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:47.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:47.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:47.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:47.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:48.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:48.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:48.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:48.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:49.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:49.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:49.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:49.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:50.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:50.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:50.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:50.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:51.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:51.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:51.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:51.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:52.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:52.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:52.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:52.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:53.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:53.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:53.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:53.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:54.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:54.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:54.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:54.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:55.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:55.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:55.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:55.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:56.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:56.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:56.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:56.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:57.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:57.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:57.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:57.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:58.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:58.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:58.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:58.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:59.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:43:59.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:43:59.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:43:59.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:00.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:00.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:00.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:00.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:01.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:01.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:01.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:01.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:02.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:02.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:02.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:02.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:03.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:03.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:03.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:03.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:04.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:04.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:04.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:04.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:05.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:05.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:05.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:05.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:06.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:06.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:06.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:06.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:07.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:07.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:07.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:07.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:08.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:08.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:08.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:08.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:09.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:09.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:09.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:09.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:10.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:10.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:10.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:10.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:11.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:11.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:11.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:11.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:12.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:12.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:12.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:12.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:13.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:13.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:13.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:13.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:14.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:14.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:14.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:14.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:15.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:15.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:15.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:15.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:16.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:16.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:16.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:16.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:17.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:17.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:17.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:17.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:18.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:18.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:18.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:18.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:19.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:19.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:19.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:19.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:20.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:20.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:20.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:20.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:21.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:21.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:21.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:21.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:22.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:22.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:22.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:22.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:23.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:23.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:23.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:23.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:24.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:24.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:24.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:24.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:25.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:25.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:25.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:25.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:26.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:26.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:26.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:26.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:27.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:27.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:27.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:27.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:28.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:28.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:28.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:28.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:29.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:29.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:29.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:29.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:30.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:30.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:30.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:30.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:31.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:31.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:31.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:31.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:32.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:32.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:32.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:32.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:33.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:33.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:33.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:33.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:34.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:34.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:34.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:34.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:35.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:35.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:35.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:35.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:36.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:36.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:36.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:36.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:37.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:37.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:37.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:37.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:38.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:38.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:38.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:38.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:39.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:39.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:39.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:39.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:40.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:40.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:40.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:40.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:41.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:41.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:41.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:41.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:42.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:42.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:42.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:42.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:43.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:43.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:43.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:43.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:44.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:44.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:44.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:44.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:45.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:45.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:45.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:45.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:46.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:46.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:46.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:46.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:47.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:47.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:47.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:47.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:48.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:48.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:48.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:48.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:49.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:49.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:49.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:49.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:50.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:50.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:50.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:50.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:51.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:51.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:51.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:51.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:52.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:52.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:52.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:52.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:53.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:53.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:53.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:53.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:54.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:54.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:54.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:54.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:55.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:55.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:55.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:55.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:56.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:56.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:56.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:56.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:57.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:57.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:57.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:57.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:58.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:58.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:58.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:58.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:59.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:44:59.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:44:59.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:44:59.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:00.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:00.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:00.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:00.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:01.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:01.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:01.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:01.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:02.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:02.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:02.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:02.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:03.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:03.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:03.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:03.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:04.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:04.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:04.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:04.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:05.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:05.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:05.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:05.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:06.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:06.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:06.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:06.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:07.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:07.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:07.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:07.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:08.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:08.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:08.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:08.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:09.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:09.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:09.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:09.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:10.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:10.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:10.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:10.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:11.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:11.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:11.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:11.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:12.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:12.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:12.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:12.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:13.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:13.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:13.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:13.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:14.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:14.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:14.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:14.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:15.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:15.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:15.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:15.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:16.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:16.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:16.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:16.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:17.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:17.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:17.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:17.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:18.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:18.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:18.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:18.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:19.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:19.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:19.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:19.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:20.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:20.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:20.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:20.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:21.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:21.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:21.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:21.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:22.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:22.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:22.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:22.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:23.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:23.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:23.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:23.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:24.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:24.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:24.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:24.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:25.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:25.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:25.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:25.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:26.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:26.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:26.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:26.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:27.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:27.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:27.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:27.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:28.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:28.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:28.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:28.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:29.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:29.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:29.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:29.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:30.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:30.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:30.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:30.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:31.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:31.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:31.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:31.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:32.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:32.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:32.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:32.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:33.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:33.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:33.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:33.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:34.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:34.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:34.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:34.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:35.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:35.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:35.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:35.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:36.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:36.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:36.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:36.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:37.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:37.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:37.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:37.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:38.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:38.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:38.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:38.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:39.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:39.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:39.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:39.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:40.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:40.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:40.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:40.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:41.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:41.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:41.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:41.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:42.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:42.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:42.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:42.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:43.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:43.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:43.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:43.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:44.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:44.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:44.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:44.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:45.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:45.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:45.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:45.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:46.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:46.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:46.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:46.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:47.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:47.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:47.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:47.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:48.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:48.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:48.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:48.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:49.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:49.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:49.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:49.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:50.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:50.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:50.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:50.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:51.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:51.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:51.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:51.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:52.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:52.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:52.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:52.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:53.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:53.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:53.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:53.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:54.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:54.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:54.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:54.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:55.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:55.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:55.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:55.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:56.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:56.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:56.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:56.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:57.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:57.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:57.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:57.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:58.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:58.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:58.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:58.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:59.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:45:59.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:45:59.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:45:59.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:00.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:00.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:00.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:00.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:01.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:01.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:01.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:01.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:02.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:02.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:02.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:02.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:03.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:03.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:03.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:03.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:04.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:04.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:04.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:04.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:05.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:05.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:05.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:05.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:06.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:06.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:06.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:06.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:07.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:07.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:07.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:07.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:08.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:08.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:08.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:08.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:09.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:09.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:09.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:09.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:10.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:10.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:10.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:10.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:11.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:11.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:11.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:11.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:12.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:12.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:12.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:12.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:13.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:13.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:13.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:13.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:14.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:14.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:14.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:14.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:15.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:15.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:15.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:15.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:16.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:16.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:16.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:16.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:17.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:17.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:17.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:17.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:18.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:18.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:18.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:18.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:19.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:19.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:19.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:19.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:20.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:20.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:20.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:20.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:21.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:21.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:21.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:21.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:22.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:22.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:22.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:22.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:23.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:23.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:23.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:23.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:24.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:24.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:24.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:24.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:25.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:25.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:25.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:25.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:26.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:26.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:26.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:26.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:27.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:27.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:27.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:27.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:28.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:28.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:28.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:28.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:29.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:29.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:29.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:29.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:30.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:30.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:30.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:30.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:31.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:31.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:31.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:31.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:32.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:32.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:32.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:32.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:33.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:33.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:33.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:33.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:34.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:34.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:34.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:34.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:35.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:35.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:35.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:35.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:36.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:36.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:36.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:36.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:37.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:37.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:37.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:37.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:38.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:38.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:38.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:38.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:39.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:39.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:39.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:39.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:40.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:40.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:40.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:40.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:41.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:41.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:41.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:41.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:42.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:42.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:42.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:42.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:43.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:43.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:43.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:43.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:44.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:44.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:44.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:44.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:45.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:45.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:45.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:45.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:46.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:46.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:46.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:46.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:47.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:47.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:47.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:47.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:48.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:48.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:48.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:48.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:49.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:49.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:49.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:49.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:50.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:50.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:50.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:50.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:51.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:51.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:51.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:51.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:52.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:52.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:52.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:52.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:53.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:53.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:53.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:53.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:54.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:54.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:54.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:54.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:55.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:55.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:55.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:55.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:56.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:56.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:56.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:56.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:57.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:57.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:57.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:57.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:58.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:58.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:58.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:58.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:59.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:46:59.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:46:59.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:46:59.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:00.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:00.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:00.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:00.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:01.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:01.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:01.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:01.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:02.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:02.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:02.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:02.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:03.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:03.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:03.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:03.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:04.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:04.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:04.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:04.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:05.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:05.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:05.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:05.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:06.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:06.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:06.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:06.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:07.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:07.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:07.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:07.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:08.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:08.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:08.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:08.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:09.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:09.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:09.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:09.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:10.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:10.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:10.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:10.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:11.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:11.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:11.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:11.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:12.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:12.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:12.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:12.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:13.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:13.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:13.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:13.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:14.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:14.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:14.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:14.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:15.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:15.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:15.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:15.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:16.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:16.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:16.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:16.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:17.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:17.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:17.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:17.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:18.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:18.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:18.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:18.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:19.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:19.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:19.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:19.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:20.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:20.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:20.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:20.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:21.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:21.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:21.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:21.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:22.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:22.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:22.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:22.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:23.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:23.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:23.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:23.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:24.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:24.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:24.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:24.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:25.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:25.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:25.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:25.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:26.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:26.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:26.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:26.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:27.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:27.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:27.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:27.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:28.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:28.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:28.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:28.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:29.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:29.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:29.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:29.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:30.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:30.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:30.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:30.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:31.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:31.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:31.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:31.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:32.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:32.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:32.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:32.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:33.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:33.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:33.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:33.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:34.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:34.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:34.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:34.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:35.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:35.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:35.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:35.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:36.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:36.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:36.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:36.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:37.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:37.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:37.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:37.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:38.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:38.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:38.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:38.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:39.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:39.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:39.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:39.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:40.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:40.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:40.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:40.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:41.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:41.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:41.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:41.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:42.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:42.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:42.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:42.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:43.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:43.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:43.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:43.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:44.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:44.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:44.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:44.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:45.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:45.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:45.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:45.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:46.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:46.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:46.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:46.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:47.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:47.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:47.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:47.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:48.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:48.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:48.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:48.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:49.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:49.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:49.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:49.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:50.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:50.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:50.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:50.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:51.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:51.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:51.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:51.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:52.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:52.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:52.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:52.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:53.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:53.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:53.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:53.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:54.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:54.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:54.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:54.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:55.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:55.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:55.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:55.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:56.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:56.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:56.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:56.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:57.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:57.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:57.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:57.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:58.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:58.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:58.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:58.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:59.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:47:59.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:47:59.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:47:59.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:00.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:00.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:00.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:00.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:01.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:01.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:01.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:01.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:02.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:02.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:02.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:02.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:03.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:03.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:03.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:03.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:04.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:04.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:04.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:04.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:05.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:05.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:05.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:05.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:06.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:06.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:06.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:06.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:07.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:07.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:07.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:07.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:08.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:08.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:08.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:08.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:09.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:09.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:09.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:09.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:10.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:10.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:10.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:10.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:11.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:11.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:11.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:11.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:12.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:12.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:12.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:12.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:13.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:13.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:13.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:13.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:14.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:14.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:14.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:14.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:15.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:15.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:15.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:15.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:16.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:16.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:16.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:16.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:17.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:17.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:17.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:17.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:18.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:18.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:18.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:18.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:19.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:19.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:19.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:19.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:20.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:20.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:20.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:20.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:21.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:21.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:21.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:21.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:22.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:22.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:22.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:22.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:23.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:23.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:23.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:23.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:24.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:24.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:24.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:24.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:25.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:25.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:25.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:25.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:26.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:26.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:26.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:26.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:27.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:27.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:27.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:27.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:28.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:28.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:28.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:28.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:29.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:29.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:29.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:29.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:30.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:30.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:30.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:30.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:31.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:31.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:31.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:31.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:32.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:32.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:32.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:32.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:33.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:33.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:33.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:33.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:34.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:34.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:34.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:34.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:35.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:35.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:35.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:35.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:36.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:36.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:36.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:36.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:37.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:37.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:37.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:37.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:38.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:38.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:38.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:38.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:39.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:39.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:39.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:39.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:40.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:40.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:40.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:40.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:41.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:41.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:41.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:41.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:42.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:42.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:42.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:42.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:43.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:43.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:43.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:43.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:44.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:44.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:44.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:44.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:45.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:45.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:45.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:45.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:46.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:46.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:46.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:46.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:47.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:47.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:47.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:47.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:48.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:48.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:48.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:48.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:49.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:49.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:49.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:49.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:50.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:50.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:50.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:50.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:51.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:51.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:51.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:51.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:52.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:52.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:52.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:52.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:53.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:52.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:53.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:53.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:54.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:54.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:54.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:54.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:54.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:54.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:55.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:55.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:55.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:55.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:56.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:56.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:57.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:57.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:57.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:57.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:58.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:58.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:58.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:58.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:59.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:48:59.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:48:59.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:48:59.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:00.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:00.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:00.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:00.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:01.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:01.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:01.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:01.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:02.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:02.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:02.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:02.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:03.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:03.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:03.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:03.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:03.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:03.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:04.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:04.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:04.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:04.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:05.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:05.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:06.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:06.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:06.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:06.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:07.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:07.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:07.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:07.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:08.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:08.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:08.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:08.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:09.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:09.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:09.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:09.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:09.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:09.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:10.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:10.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:11.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:11.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:11.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:11.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:12.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:12.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:12.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:12.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:13.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:13.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:13.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:13.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:13.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:13.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:14.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:14.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:14.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:14.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:15.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:15.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:15.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:15.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:16.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:16.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:16.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:16.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:17.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:17.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:17.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:17.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:18.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:18.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:19.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:18.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:19.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:19.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:19.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:19.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:20.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:20.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:21.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:21.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:21.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:21.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:22.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:21.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:22.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:22.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:23.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:22.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:24.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:23.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:24.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:24.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:24.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:24.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:25.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:25.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:25.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:25.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:26.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:26.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:26.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:26.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:27.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:27.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:28.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:28.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:28.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:28.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:29.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:29.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:29.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:29.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:30.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:30.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:30.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:30.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:31.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:31.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:31.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:31.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:32.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:32.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:32.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:32.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:33.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:33.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:33.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:33.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:34.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:34.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:34.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:34.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:35.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:35.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:35.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:35.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:36.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:36.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:36.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:36.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:37.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:37.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:37.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:37.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:38.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:38.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:38.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:38.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:39.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:38.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:39.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:39.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:39.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:39.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:40.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:40.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:40.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:40.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:41.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:41.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:41.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:41.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:42.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:42.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:42.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:42.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:43.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:43.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:43.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:43.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:44.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:44.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:45.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:45.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:45.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:45.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:45.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:45.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:46.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:46.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:46.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:46.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:46.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:46.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:47.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:47.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:48.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:48.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:48.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:48.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:48.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:48.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:49.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:49.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:49.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:49.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:50.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:50.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:51.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:50.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:51.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:51.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:52.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:52.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:52.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:52.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:53.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:52.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:53.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:53.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:53.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:53.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:54.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:54.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:54.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:54.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:55.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:55.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:55.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:55.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:56.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:56.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:56.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:56.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:57.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:57.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:57.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:57.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:58.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:58.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:58.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:58.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:59.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:49:59.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:49:59.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:49:59.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:00.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:00.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:00.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:00.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:01.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:01.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:01.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:01.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:02.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:02.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:02.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:02.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:03.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:03.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:03.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:03.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:04.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:04.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:04.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:04.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:05.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:05.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:05.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:05.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:06.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:06.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:06.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:06.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:07.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:07.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:07.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:07.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:08.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:08.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:09.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:09.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:09.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:09.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:10.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:10.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:10.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:10.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:11.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:11.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:11.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:11.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:12.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:12.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:12.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:12.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:13.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:13.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:13.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:13.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:14.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:14.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:14.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:14.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:15.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:15.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:15.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:15.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:16.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:16.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:16.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:16.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:17.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:17.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:17.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:17.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:18.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:18.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:18.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:18.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:19.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:19.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:19.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:19.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:20.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:20.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:20.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:20.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:21.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:21.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:21.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:21.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:22.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:21.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:22.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:22.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:22.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:22.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:23.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:23.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:23.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:23.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:24.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:24.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:24.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:24.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:25.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:25.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:25.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:25.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:26.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:26.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:26.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:26.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:27.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:27.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:27.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:27.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:28.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:28.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:28.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:28.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:29.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:29.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:29.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:29.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:30.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:30.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:30.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:30.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:31.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:31.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:31.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:31.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:32.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:32.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:32.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:32.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:33.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:33.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:33.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:33.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:34.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:34.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:34.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:34.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:35.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:35.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:35.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:35.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:36.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:36.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:36.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:36.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:37.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:37.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:38.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:38.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:38.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:38.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:38.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:38.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:39.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:39.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:40.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:39.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:40.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:40.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:41.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:40.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:41.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:41.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:42.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:42.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:43.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:43.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:43.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:43.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:44.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:44.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:44.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:44.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:45.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:44.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:45.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:45.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:46.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:46.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:46.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:46.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:47.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:47.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:47.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:47.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:48.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:48.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:48.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:48.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:49.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:49.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:49.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:49.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:50.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:50.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:50.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:50.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:51.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:51.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:51.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:51.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:52.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:52.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:52.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:52.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:53.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:53.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:53.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:53.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:54.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:54.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:54.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:54.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:55.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:55.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:55.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:55.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:56.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:56.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:56.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:56.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:57.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:57.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:57.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:57.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:58.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:58.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:58.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:58.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:59.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:50:59.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:50:59.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:50:59.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:00.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:00.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:00.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:00.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:00.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:00.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:01.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:01.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:01.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:01.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:02.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:02.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:02.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:02.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:03.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:03.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:03.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:03.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:04.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:04.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:05.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:05.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:05.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:05.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:06.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:05.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:06.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:06.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:07.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:07.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:07.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:07.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:08.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:08.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:08.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:08.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:09.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:08.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:09.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:09.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:09.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:09.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:10.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:09.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:10.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:10.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:11.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:11.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:11.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:11.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:12.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:12.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:13.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:12.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:13.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:13.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:13.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:13.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:14.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:14.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:14.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:14.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:15.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:15.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:15.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:15.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:16.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:16.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:16.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:16.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:17.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:17.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:17.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:17.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:18.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:18.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:18.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:18.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:19.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:19.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:19.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:19.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:20.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:20.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:20.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:20.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:21.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:21.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:21.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:21.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:22.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:22.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:22.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:22.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:23.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:23.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:23.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:23.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:24.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:24.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:24.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:24.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:25.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:25.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:25.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:25.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:26.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:26.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:26.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:26.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:27.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:27.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:27.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:27.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:28.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:28.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:28.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:28.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:29.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:29.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:29.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:29.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:30.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:30.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:30.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:30.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:31.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:31.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:31.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:31.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:31.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:31.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:32.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:32.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:32.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:32.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:33.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:33.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:33.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:33.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:34.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:34.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:34.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:34.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:35.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:35.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:35.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:35.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:36.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:36.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:36.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:36.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:37.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:37.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:37.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:37.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:38.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:38.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:38.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:38.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:39.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:39.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:39.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:39.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:40.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:40.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:40.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:40.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:41.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:41.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:41.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:41.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:42.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:42.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:42.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:42.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:43.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:43.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:43.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:43.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:44.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:44.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:44.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:44.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:45.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:45.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:45.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:45.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:46.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:46.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:46.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:46.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:47.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:47.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:47.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:47.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:48.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:48.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:48.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:48.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:49.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:49.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:49.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:49.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:50.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:50.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:50.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:50.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:51.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:51.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:51.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:51.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:52.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:52.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:52.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:52.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:53.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:53.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:53.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:53.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:54.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:54.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:54.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:54.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:55.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:55.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:55.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:55.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:56.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:56.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:56.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:56.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:57.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:57.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:57.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:57.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:58.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:58.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:58.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:51:58.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:51:59.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:51:59.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:00.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:00.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:00.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:00.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:01.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:01.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:01.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:01.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:01.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:01.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:02.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:02.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:03.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:03.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:03.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:03.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:04.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:04.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:04.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:04.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:05.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:05.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:05.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:05.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:06.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:06.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:06.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:06.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:07.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:07.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:07.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:07.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:08.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:08.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:08.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:08.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:09.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:09.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:09.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:09.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:10.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:10.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:10.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:10.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:11.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:11.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:11.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:11.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:12.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:12.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:12.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:12.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:13.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:13.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:13.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:13.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:14.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:14.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:14.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:14.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:15.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:15.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:15.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:15.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:16.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:16.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:16.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:16.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:17.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:17.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:17.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:17.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:18.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:18.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:18.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:18.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:19.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:19.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:19.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:19.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:20.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:20.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:20.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:20.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:21.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:21.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:21.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:21.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:22.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:22.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:22.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:22.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:23.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:23.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:23.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:23.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:24.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:24.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:24.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:24.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:25.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:25.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:25.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:25.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:26.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:26.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:26.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:26.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:27.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:27.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:27.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:27.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:28.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:28.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:28.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:28.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:29.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:29.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:29.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:29.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:30.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:30.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:30.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:30.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:31.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:31.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:31.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:31.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:32.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:32.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:32.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:32.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:33.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:33.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:33.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:33.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:34.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:34.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:34.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:34.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:35.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:35.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:35.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:35.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:36.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:36.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:36.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:36.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:37.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:37.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:37.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:37.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:38.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:38.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:38.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:38.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:39.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:39.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:39.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:39.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:40.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:40.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:40.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:40.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:41.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:41.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:41.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:41.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:42.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:42.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:42.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:42.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:43.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:43.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:43.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:43.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:44.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:44.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:44.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:44.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:45.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:45.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:45.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:45.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:46.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:46.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:46.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:46.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:47.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:47.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:47.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:47.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:48.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:48.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:48.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:48.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:49.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:49.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:49.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:49.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:50.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:50.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:50.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:50.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:51.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:51.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:51.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:51.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:52.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:52.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:52.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:52.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:53.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:53.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:53.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:53.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:54.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:54.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:54.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:54.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:55.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:55.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:55.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:55.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:56.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:56.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:56.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:56.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:57.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:57.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:57.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:57.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:58.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:58.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:58.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:58.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:59.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:52:59.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:52:59.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:52:59.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:00.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:00.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:00.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:00.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:01.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:01.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:01.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:01.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:02.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:02.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:02.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:02.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:03.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:03.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:03.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:03.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:04.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:04.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:04.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:04.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:05.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:05.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:05.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:05.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:06.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:06.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:06.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:06.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:07.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:07.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:07.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:07.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:08.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:08.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:08.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:08.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:09.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:09.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:09.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:09.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:10.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:10.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:10.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:10.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:11.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:11.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:11.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:11.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:12.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:12.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:12.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:12.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:13.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:13.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:13.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:13.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:14.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:14.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:14.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:14.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:15.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:15.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:15.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:15.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:16.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:16.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:16.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:16.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:17.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:17.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:17.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:17.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:18.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:18.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:18.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:18.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:19.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:19.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:19.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:19.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:20.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:20.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:20.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:20.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:21.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:21.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:21.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:21.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:22.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:22.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:23.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:23.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:23.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:23.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:24.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:24.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:24.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:24.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:25.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:25.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:25.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:25.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:25.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:25.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:26.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:26.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:26.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:26.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:27.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:27.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:28.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:28.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:28.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:28.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:29.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:29.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:29.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:29.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:30.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:30.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:30.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:30.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:31.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:31.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:31.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:31.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:32.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:32.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:32.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:32.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:33.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:33.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:33.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:33.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:34.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:34.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:34.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:34.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:35.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:35.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:35.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:35.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:36.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:36.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:36.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:36.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:37.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:37.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:37.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:37.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:38.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:38.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:38.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:38.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:39.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:39.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:39.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:39.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:40.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:40.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:40.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:40.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:41.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:41.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:41.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:41.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:42.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:42.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:42.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:42.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:43.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:43.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:43.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:43.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:44.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:44.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:44.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:44.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:45.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:45.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:45.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:45.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:46.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:46.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:46.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:46.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:47.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:47.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:47.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:47.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:48.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:48.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:48.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:48.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:49.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:49.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:49.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:49.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:50.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:50.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:50.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:50.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:51.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:51.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:51.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:51.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:52.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:52.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:52.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:52.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:53.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:53.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:53.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:53.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:54.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:54.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:54.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:54.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:55.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:55.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:55.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:55.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:56.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:56.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:56.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:56.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:57.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:57.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:57.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:57.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:58.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:58.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:58.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:58.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:59.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:53:59.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:53:59.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:53:59.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:00.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:00.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:00.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:00.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:01.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:01.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:01.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:01.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:02.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:02.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:02.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:02.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:03.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:03.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:03.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:03.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:04.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:04.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:04.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:04.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:05.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:05.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:05.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:05.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:05.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:05.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:06.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:06.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:07.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:06.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:07.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:07.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:07.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:07.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:08.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:08.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:08.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:08.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:09.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:09.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:09.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:09.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:10.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:10.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:10.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:10.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:11.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:11.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:11.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:11.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:12.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:12.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:12.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:12.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:13.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:13.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:13.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:13.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:14.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:14.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:14.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:14.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:15.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:15.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:15.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:15.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:16.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:16.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:16.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:16.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:17.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:17.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:17.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:17.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:18.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:18.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:18.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:18.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:19.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:19.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:19.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:19.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:20.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:20.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:20.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:20.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:21.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:21.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:21.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:21.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:22.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:22.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:23.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:22.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:23.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:23.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:24.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:24.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:24.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:24.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:25.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:25.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:25.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:25.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:26.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:26.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:26.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:26.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:27.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:27.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:27.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:27.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:28.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:28.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:28.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:28.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:29.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:29.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:29.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:29.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:30.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:30.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:30.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:30.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:31.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:31.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:31.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:31.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:32.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:32.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:32.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:32.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:33.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:33.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:33.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:33.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:34.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:34.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:34.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:34.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:35.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:35.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:35.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:35.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:36.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:36.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:36.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:36.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:37.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:37.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:37.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:37.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:38.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:38.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:38.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:38.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:39.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:39.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:39.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:39.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:40.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:40.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:40.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:40.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:41.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:41.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:41.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:41.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:42.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:42.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:42.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:42.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:43.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:43.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:43.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:43.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:44.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:44.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:44.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:44.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:45.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:45.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:45.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:45.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:46.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:46.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:46.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:46.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:47.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:47.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:47.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:47.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:48.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:48.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:48.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:48.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:49.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:49.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:49.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:49.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:50.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:50.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:50.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:50.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:51.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:51.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:51.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:51.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:52.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:52.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:52.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:52.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:53.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:53.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:53.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:53.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:54.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:54.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:54.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:54.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:55.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:55.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:55.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:55.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:56.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:56.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:56.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:56.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:57.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:57.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:57.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:57.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:58.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:58.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:58.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:58.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:59.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:54:59.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:54:59.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:54:59.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:00.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:00.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:00.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:00.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:01.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:01.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:01.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:01.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:02.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:02.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:02.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:02.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:03.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:03.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:03.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:03.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:04.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:04.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:04.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:04.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:05.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:05.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:05.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:05.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:06.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:06.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:06.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:06.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:07.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:07.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:07.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:07.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:08.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:08.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:08.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:08.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:09.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:09.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:09.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:09.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:10.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:10.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:10.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:10.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:11.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:11.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:11.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:11.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:12.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:12.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:12.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:12.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:13.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:13.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:13.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:13.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:14.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:14.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:14.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:14.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:15.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:15.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:15.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:15.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:16.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:16.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:16.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:16.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:17.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:17.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:17.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:17.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:18.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:18.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:18.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:18.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:19.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:19.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:19.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:19.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:20.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:20.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:20.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:20.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:21.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:21.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:21.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:21.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:22.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:22.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:22.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:22.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:23.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:23.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:23.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:23.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:24.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:24.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:24.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:24.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:25.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:25.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:25.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:25.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:26.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:26.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:26.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:26.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:27.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:27.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:27.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:27.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:28.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:28.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:28.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:28.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:29.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:29.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:29.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:29.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:30.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:30.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:30.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:30.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:31.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:31.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:31.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:31.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:32.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:32.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:32.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:32.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:33.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:33.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:33.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:33.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:34.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:34.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:34.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:34.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:35.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:35.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:35.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:36.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:36.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:36.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:36.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:37.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:37.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:37.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:37.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:38.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:38.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:38.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:38.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:39.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:39.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:39.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:40.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:40.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:40.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:40.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:41.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:41.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:41.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:41.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:42.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:42.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:42.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:42.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:43.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:43.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:43.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:43.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:44.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:44.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:44.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:44.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:45.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:45.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:45.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:45.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:46.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:46.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:46.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:46.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:47.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:47.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:47.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:47.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:48.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:48.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:48.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:48.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:49.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:49.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:49.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:49.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:50.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:50.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:50.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:50.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:51.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:51.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:51.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:51.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:52.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:52.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:52.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:52.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:53.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:53.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:53.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:53.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:54.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:54.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:54.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:54.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:55.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:55.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:55.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:55.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:56.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:56.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:56.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:56.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:57.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:57.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:57.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:57.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:58.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:58.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:58.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:58.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:59.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:55:59.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:55:59.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:55:59.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:00.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:00.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:00.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:00.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:01.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:01.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:01.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:01.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:02.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:02.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:02.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:02.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:03.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:03.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:03.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:03.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:04.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:04.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:04.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:04.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:05.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:05.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:05.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:05.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:06.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:06.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:06.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:06.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:07.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:07.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:07.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:07.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:08.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:08.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:08.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:08.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:09.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:09.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:09.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:09.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:10.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:10.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:10.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:10.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:11.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:11.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:11.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:11.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:12.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:12.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:12.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:12.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:13.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:13.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:13.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:13.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:14.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:14.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:14.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:14.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:15.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:15.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:15.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:15.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:16.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:16.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:16.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:16.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:17.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:17.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:17.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:17.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:18.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:18.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:18.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:18.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:19.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:19.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:19.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:19.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:20.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:20.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:20.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:20.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:21.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:21.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:21.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:21.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:22.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:22.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:22.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:22.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:23.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:23.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:23.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:23.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:24.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:24.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:24.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:24.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:25.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:25.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:25.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:25.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:26.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:26.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:26.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:26.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:27.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:27.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:27.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:27.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:28.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:28.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:28.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:28.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:29.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:29.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:29.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:29.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:30.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:30.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:30.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:30.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:31.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:31.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:31.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:31.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:32.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:32.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:32.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:32.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:33.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:33.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:33.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:33.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:34.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:34.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:34.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:34.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:35.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:35.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:35.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:35.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:36.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:36.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:36.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:36.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:37.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:37.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:37.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:37.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:38.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:38.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:38.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:38.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:39.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:39.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:39.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:39.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:40.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:40.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:40.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:40.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:41.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:41.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:41.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:41.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:42.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:42.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:42.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:42.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:43.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:43.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:43.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:43.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:44.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:44.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:44.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:44.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:45.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:45.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:45.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:45.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:46.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:46.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:46.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:46.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:47.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:47.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:47.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:47.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:48.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:48.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:48.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:48.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:49.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:49.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:49.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:49.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:50.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:50.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:50.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:50.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:51.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:51.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:51.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:51.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:52.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:52.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:52.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:52.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:53.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:53.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:53.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:53.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:54.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:54.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:54.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:54.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:55.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:55.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:55.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:55.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:56.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:56.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:56.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:56.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:57.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:57.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:57.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:57.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:58.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:58.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:58.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:58.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:59.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:56:59.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:56:59.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:56:59.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:00.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:00.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:00.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:00.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:01.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:01.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:01.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:01.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:02.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:02.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:02.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:02.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:03.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:03.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:03.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:03.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:04.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:04.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:04.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:04.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:05.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:05.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:05.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:05.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:06.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:06.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:07.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:07.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:07.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:07.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:08.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:08.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:08.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:08.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:08.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:08.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:09.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:09.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:09.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:09.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:10.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:10.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:10.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:10.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:11.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:11.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:11.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:11.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:12.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:12.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:12.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:12.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:13.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:13.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:13.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:13.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:14.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:14.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:14.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:14.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:15.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:15.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:16.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:16.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:16.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:16.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:17.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:17.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:17.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:17.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:18.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:18.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:18.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:18.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:19.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:19.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:19.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:19.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:19.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:19.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:20.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:20.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:21.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:21.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:21.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:21.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:21.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:21.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:22.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:22.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:22.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:22.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:23.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:23.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:23.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:23.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:24.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:24.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:24.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:24.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:25.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:25.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:25.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:25.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:26.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:26.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:26.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:26.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:27.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:27.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:27.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:27.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:28.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:28.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:28.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:28.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:29.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:29.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:29.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:29.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:30.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:30.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:30.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:30.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:31.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:31.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:31.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:31.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:32.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:32.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:32.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:32.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:33.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:33.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:34.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:34.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:34.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:34.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:35.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:35.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:35.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:35.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:36.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:36.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:36.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:36.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:37.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:37.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:37.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:37.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:38.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:38.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:38.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:38.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:39.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:39.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:39.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:39.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:40.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:40.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:40.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:40.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:41.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:41.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:41.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:41.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:42.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:42.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:42.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:42.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:43.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:43.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:43.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:43.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:44.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:44.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:44.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:44.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:45.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:45.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:46.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:45.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:46.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:46.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:46.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:46.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:47.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:47.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:47.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:47.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:48.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:48.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:48.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:48.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:49.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:49.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:49.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:49.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:50.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:50.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:51.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:51.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:51.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:51.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:52.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:52.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:52.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:52.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:53.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:53.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:53.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:53.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:54.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:54.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:54.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:54.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:55.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:55.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:55.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:55.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:56.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:56.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:56.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:56.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:57.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:57.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:57.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:57.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:58.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:58.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:58.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:58.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:59.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:57:59.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:57:59.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:57:59.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:00.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:00.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:00.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:00.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:01.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:01.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:01.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:01.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:02.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:02.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:02.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:02.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:03.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:03.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:03.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:03.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:03.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:03.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:04.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:04.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:04.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:04.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:05.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:05.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:06.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:06.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:06.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:06.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:06.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:06.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:07.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:07.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:07.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:07.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:08.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:07.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:08.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:08.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:09.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:09.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:09.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:09.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:09.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:09.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:10.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:10.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:11.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:10.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:11.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:11.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:12.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:12.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:12.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:12.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:13.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:13.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:13.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:13.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:14.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:14.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:14.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:14.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:15.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:15.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:15.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:15.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:16.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:16.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:16.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:16.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:17.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:17.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:17.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:17.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:18.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:18.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:18.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:18.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:19.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:19.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:19.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:19.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:20.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:19.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:20.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:20.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:20.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:20.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:21.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:21.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:21.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:21.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:22.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:22.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:23.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:22.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:23.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:23.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:24.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:23.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:24.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:24.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:25.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:25.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:25.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:25.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:26.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:26.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:26.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:26.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:27.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:27.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:27.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:27.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:28.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:28.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:28.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:28.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:29.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:29.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:29.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:29.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:30.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:30.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:30.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:30.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:31.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:31.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:31.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:31.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:32.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:32.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:32.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:32.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:33.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:33.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:33.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:33.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:34.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:34.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:34.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:34.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:35.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:35.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:35.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:35.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:36.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:36.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:36.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:36.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:37.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:37.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:37.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:37.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:38.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:38.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:38.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:38.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:39.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:39.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:39.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:39.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:40.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:40.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:40.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:40.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:41.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:41.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:41.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:41.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:42.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:42.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:42.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:42.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:43.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:43.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:43.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:43.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:44.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:44.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:44.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:44.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:45.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:45.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:45.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:45.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:46.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:46.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:46.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:46.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:47.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:47.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:47.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:47.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:48.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:48.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:48.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:48.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:49.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:49.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:49.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:49.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:50.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:49.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:50.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:50.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:50.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:50.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:51.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:51.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:51.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:51.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:52.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:52.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:52.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:52.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:53.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:53.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:53.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:53.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:54.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:54.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:54.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:54.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:55.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:55.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:55.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:55.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:56.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:56.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:56.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:56.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:57.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:57.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:57.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:57.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:58.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:58.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:58.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:58.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:59.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:58:59.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:58:59.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:58:59.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:00.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:00.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:00.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:00.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:01.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:01.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:01.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:01.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:02.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:02.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:02.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:02.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:03.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:03.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:03.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:03.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:04.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:04.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:04.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:04.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:05.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:05.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:05.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:05.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:06.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:06.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:06.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:06.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:07.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:07.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:07.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:07.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:08.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:08.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:08.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:08.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:09.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:09.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:09.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:09.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:10.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:10.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:10.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:10.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:11.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:11.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:11.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:11.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:12.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:12.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:12.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:12.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:13.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:13.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:13.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:13.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:14.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:14.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:14.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:14.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:15.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:15.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:15.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:15.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:16.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:16.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:16.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:16.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:17.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:17.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:17.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:17.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:18.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:18.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:18.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:18.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:19.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:19.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:19.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:19.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:20.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:20.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:20.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:20.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:21.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:21.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:21.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:21.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:22.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:22.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:22.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:22.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:23.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:23.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:23.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:23.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:24.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:24.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:24.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:24.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:25.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:25.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:25.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:25.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:26.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:26.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:26.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:26.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:27.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:27.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:27.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:27.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:28.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:28.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:28.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:28.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:29.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:29.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:29.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:29.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:30.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:30.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:30.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:30.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:31.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:31.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:31.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:31.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:32.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:32.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:32.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:32.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:33.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:33.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:33.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:33.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:34.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:34.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:34.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:34.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:35.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:35.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:35.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:35.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:36.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:36.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:36.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:36.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:37.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:37.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:37.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:37.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:38.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:38.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:38.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:38.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:39.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:39.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:39.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:39.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:40.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:40.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:41.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:41.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:41.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:41.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:42.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:42.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:42.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:42.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:43.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:43.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:43.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:43.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:44.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:44.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:44.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:44.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:45.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:45.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:45.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:45.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:46.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:46.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:46.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:46.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:47.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:47.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:47.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:47.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:48.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:48.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:48.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:48.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:49.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:49.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:49.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:49.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:50.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:50.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:50.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:50.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:51.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:51.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:51.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:51.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:52.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:52.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:52.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:52.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:53.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:53.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:53.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:53.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:54.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:54.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:54.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:54.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:55.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:55.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:55.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:55.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:56.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:56.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:56.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:56.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:57.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:57.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:57.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:57.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:58.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:58.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:58.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:58.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:59.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T04:59:59.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T04:59:59.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T04:59:59.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:00.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:00.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:00.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:00.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:01.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:01.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:01.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:01.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:02.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:02.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:02.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:02.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:03.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:03.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:03.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:03.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:04.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:04.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:04.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:04.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:05.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:05.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:05.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:05.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:06.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:06.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:06.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:06.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:07.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:07.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:07.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:07.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:08.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:08.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:08.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:08.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:09.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:09.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:09.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:09.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:10.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:10.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:10.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:10.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:11.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:11.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:11.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:11.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:12.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:12.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:12.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:12.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:13.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:13.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:13.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:13.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:14.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:13.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:14.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:14.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:15.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:15.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:15.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:15.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:16.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:15.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:16.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:16.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:17.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:16.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:17.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:17.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:18.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:18.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:18.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:18.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:19.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:19.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:19.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:19.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:20.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:20.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:20.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:20.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:21.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:21.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:21.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:21.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:22.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:22.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:22.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:22.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:23.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:23.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:23.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:23.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:24.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:24.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:24.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:24.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:25.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:25.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:25.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:25.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:26.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:26.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:26.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:26.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:27.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:27.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:27.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:27.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:28.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:28.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:28.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:28.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:29.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:29.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:29.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:29.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:30.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:30.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:30.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:30.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:31.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:31.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:31.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:31.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:32.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:32.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:32.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:32.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:33.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:33.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:33.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:33.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:34.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:34.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:34.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:34.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:35.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:35.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:35.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:35.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:36.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:36.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:36.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:36.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:37.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:37.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:37.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:37.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:38.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:38.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:38.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:38.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:39.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:39.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:39.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:39.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:40.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:40.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:40.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:40.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:41.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:41.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:41.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:41.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:42.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:42.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:42.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:42.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:43.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:43.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:43.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:43.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:44.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:44.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:44.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:44.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:45.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:45.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:45.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:45.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:46.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:46.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:47.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:46.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:47.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:47.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:48.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:48.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:48.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:48.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:49.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:49.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:49.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:49.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:50.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:49.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:50.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:50.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:51.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:51.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:51.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:51.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:52.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:52.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:52.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:52.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:53.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:53.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:53.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:53.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:54.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:54.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:54.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:54.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:55.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:55.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:55.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:55.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:56.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:56.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:56.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:56.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:57.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:57.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:57.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:57.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:58.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:58.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:58.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:58.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:59.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:00:59.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:00:59.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:00:59.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:00.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:00.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:00.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:00.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:01.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:01.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:01.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:01.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:02.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:02.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:02.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:02.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:03.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:03.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:03.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:03.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:04.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:04.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:04.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:04.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:05.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:05.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:05.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:05.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:06.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:06.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:06.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:06.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:07.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:07.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:07.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:07.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:08.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:08.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:08.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:08.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:09.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:09.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:09.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:09.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:10.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:10.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:10.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:10.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:11.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:11.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:11.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:11.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:12.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:12.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:12.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:12.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:13.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:13.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:13.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:13.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:14.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:14.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:14.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:14.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:15.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:15.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:15.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:15.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:16.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:15.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:16.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:16.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:16.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:16.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:17.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:17.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:18.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:18.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:18.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:18.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:19.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:19.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:19.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:19.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:19.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:19.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:20.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:20.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:20.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:20.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:21.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:21.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:21.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:21.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:22.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:22.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:22.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:22.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:23.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:23.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:23.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:23.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:24.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:24.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:24.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:24.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:25.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:25.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:25.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:25.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:26.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:26.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:26.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:26.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:27.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:27.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:27.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:27.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:28.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:28.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:29.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:29.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:29.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:29.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:30.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:30.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:30.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:30.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:31.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:31.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:31.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:31.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:32.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:32.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:32.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:32.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:33.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:33.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:33.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:33.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:34.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:34.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:34.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:34.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:35.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:35.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:35.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:35.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:36.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:36.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:36.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:36.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:37.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:37.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:37.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:37.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:38.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:38.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:38.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:38.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:39.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:39.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:39.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:39.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:40.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:40.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:40.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:40.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:41.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:41.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:41.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:41.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:42.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:42.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:42.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:42.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:43.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:43.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:43.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:43.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:44.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:44.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:44.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:44.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:45.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:45.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:45.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:45.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:46.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:46.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:46.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:46.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:47.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:47.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:47.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:47.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:48.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:48.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:48.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:48.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:49.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:49.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:49.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:49.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:50.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:50.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:50.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:50.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:51.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:51.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:51.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:51.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:52.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:52.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:52.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:52.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:53.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:53.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:53.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:53.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:54.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:54.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:54.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:54.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:55.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:55.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:55.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:55.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:56.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:56.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:56.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:56.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:57.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:57.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:57.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:57.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:58.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:58.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:58.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:58.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:59.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:01:59.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:01:59.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:01:59.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:00.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:00.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:00.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:00.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:01.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:01.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:01.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:01.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:02.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:02.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:02.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:02.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:03.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:03.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:03.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:03.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:04.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:04.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:04.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:04.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:05.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:05.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:05.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:05.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:06.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:06.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:06.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:06.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:07.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:07.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:07.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:07.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:08.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:08.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:08.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:08.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:09.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:09.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:09.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:09.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:10.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:10.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:10.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:10.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:11.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:11.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:11.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:11.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:12.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:12.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:12.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:12.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:13.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:13.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:13.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:13.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:14.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:14.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:14.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:14.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:15.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:15.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:15.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:15.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:16.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:16.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:16.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:16.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:17.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:17.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:17.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:17.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:18.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:18.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:18.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:18.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:19.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:19.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:19.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:19.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:20.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:20.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:20.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:20.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:21.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:21.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:21.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:21.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:22.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:22.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:22.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:22.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:23.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:23.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:23.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:23.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:24.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:24.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:24.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:24.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:25.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:25.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:25.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:25.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:26.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:26.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:26.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:26.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:27.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:27.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:27.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:27.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:28.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:28.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:28.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:28.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:29.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:29.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:29.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:29.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:30.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:30.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:30.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:30.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:31.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:31.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:31.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:31.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:32.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:32.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:32.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:32.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:33.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:33.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:33.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:33.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:34.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:34.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:34.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:34.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:35.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:35.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:35.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:35.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:36.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:36.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:36.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:36.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:37.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:37.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:37.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:37.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:38.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:38.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:38.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:38.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:39.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:39.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:39.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:39.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:40.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:40.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:40.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:40.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:41.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:41.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:41.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:41.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:42.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:42.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:42.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:42.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:43.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:43.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:43.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:43.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:44.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:44.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:44.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:44.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:45.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:45.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:45.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:45.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:46.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:46.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:46.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:46.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:47.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:47.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:47.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:47.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:48.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:48.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:48.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:48.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:49.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:49.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:49.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:49.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:50.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:50.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:50.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:50.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:51.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:51.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:51.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:51.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:52.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:52.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:52.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:52.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:53.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:53.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:53.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:53.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:54.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:54.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:54.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:54.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:55.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:55.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:55.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:55.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:56.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:56.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:56.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:56.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:57.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:57.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:57.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:57.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:58.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:58.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:58.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:58.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:59.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:02:59.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:02:59.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:02:59.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:00.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:00.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:00.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:00.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:01.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:01.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:01.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:01.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:02.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:02.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:02.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:02.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:03.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:03.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:03.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:03.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:04.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:04.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:04.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:04.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:05.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:05.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:05.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:05.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:06.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:06.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:06.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:06.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:07.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:07.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:07.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:07.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:08.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:08.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:08.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:08.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:09.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:09.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:09.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:09.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:10.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:10.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:10.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:10.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:11.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:11.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:11.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:11.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:12.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:12.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:12.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:12.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:13.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:13.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:13.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:13.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:14.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:14.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:14.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:14.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:15.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:15.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:15.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:15.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:16.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:16.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:16.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:16.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:17.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:17.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:17.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:17.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:18.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:18.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:18.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:18.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:19.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:19.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:19.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:19.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:20.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:20.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:20.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:20.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:21.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:21.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:21.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:21.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:22.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:22.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:22.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:22.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:23.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:23.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:23.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:23.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:24.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:24.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:24.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:24.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:25.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:25.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:25.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:25.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:26.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:26.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:26.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:26.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:27.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:27.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:27.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:27.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:28.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:28.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:28.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:28.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:29.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:29.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:29.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:29.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:30.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:30.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:30.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:30.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:31.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:31.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:31.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:31.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:32.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:32.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:32.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:32.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:33.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:33.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:33.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:33.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:34.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:34.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:34.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:34.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:35.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:35.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:35.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:35.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:36.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:36.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:36.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:36.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:37.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:37.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:37.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:37.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:38.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:38.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:38.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:38.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:39.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:39.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:39.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:39.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:40.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:40.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:40.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:40.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:41.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:41.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:41.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:41.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:42.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:42.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:42.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:42.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:43.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:43.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:43.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:43.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:44.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:44.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:44.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:44.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:45.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:45.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:45.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:45.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:46.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:46.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:46.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:46.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:47.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:47.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:47.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:47.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:48.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:48.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:48.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:48.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:49.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:49.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:49.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:49.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:50.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:50.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:50.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:50.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:51.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:51.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:51.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:51.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:52.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:52.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:52.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:52.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:53.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:53.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:53.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:53.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:54.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:54.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:54.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:54.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:55.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:55.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:55.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:55.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:56.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:56.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:56.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:56.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:57.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:57.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:57.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:57.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:58.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:58.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:58.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:58.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:59.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:03:59.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:03:59.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:03:59.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:00.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:00.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:00.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:00.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:01.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:01.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:01.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:01.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:02.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:02.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:02.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:02.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:03.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:03.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:03.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:03.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:04.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:04.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:04.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:04.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:05.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:05.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:05.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:05.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:06.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:06.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:06.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:06.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:07.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:07.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:07.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:07.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:08.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:08.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:08.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:08.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:09.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:09.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:09.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:09.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:10.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:10.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:10.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:10.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:11.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:11.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:11.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:11.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:12.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:12.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:12.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:12.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:13.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:13.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:13.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:13.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:14.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:14.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:14.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:14.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:15.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:15.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:15.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:15.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:16.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:16.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:16.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:16.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:17.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:17.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:17.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:17.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:18.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:18.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:18.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:18.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:19.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:19.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:19.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:19.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:20.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:20.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:20.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:20.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:21.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:21.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:21.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:21.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:22.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:22.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:22.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:22.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:23.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:23.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:23.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:23.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:24.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:24.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:24.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:24.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:25.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:25.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:25.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:25.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:26.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:26.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:26.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:26.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:27.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:27.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:27.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:27.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:28.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:28.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:28.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:28.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:29.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:29.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:29.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:29.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:30.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:30.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:30.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:30.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:31.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:31.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:31.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:31.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:32.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:32.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:32.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:32.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:33.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:33.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:33.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:33.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:34.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:34.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:34.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:34.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:35.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:35.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:35.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:35.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:36.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:36.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:36.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:36.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:37.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:37.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:37.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:37.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:38.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:38.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:38.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:38.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:39.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:39.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:39.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:39.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:40.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:40.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:40.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:40.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:41.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:41.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:41.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:41.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:42.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:42.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:42.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:42.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:43.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:43.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:43.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:43.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:44.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:44.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:44.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:44.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:45.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:45.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:45.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:45.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:46.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:46.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:46.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:46.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:47.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:47.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:47.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:47.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:48.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:48.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:48.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:48.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:49.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:49.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:49.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:49.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:50.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:50.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:50.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:50.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:51.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:51.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:51.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:51.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:52.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:52.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:52.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:52.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:53.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:53.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:53.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:53.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:54.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:54.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:54.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:54.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:55.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:55.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:55.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:55.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:56.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:56.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:56.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:56.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:57.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:57.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:57.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:57.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:58.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:58.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:58.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:58.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:59.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:04:59.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:04:59.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:04:59.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:00.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:00.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:00.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:00.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:01.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:01.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:01.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:01.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:02.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:02.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:02.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:02.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:03.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:03.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:03.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:03.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:04.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:04.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:04.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:04.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:05.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:05.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:05.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:05.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:06.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:06.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:06.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:06.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:07.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:07.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:07.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:07.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:08.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:08.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:08.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:08.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:09.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:09.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:09.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:09.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:10.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:10.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:10.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:10.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:11.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:11.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:11.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:11.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:12.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:12.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:12.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:12.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:13.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:13.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:13.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:13.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:14.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:14.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:14.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:14.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:15.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:15.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:15.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:15.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:16.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:16.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:16.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:16.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:17.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:17.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:17.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:17.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:18.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:18.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:18.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:18.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:19.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:19.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:19.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:19.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:20.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:20.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:20.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:20.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:21.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:21.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:21.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:21.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:22.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:22.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:22.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:22.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:23.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:23.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:23.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:23.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:24.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:24.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:24.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:24.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:25.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:25.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:25.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:25.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:26.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:26.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:26.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:26.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:27.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:27.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:27.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:27.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:28.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:28.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:28.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:28.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:29.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:29.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:29.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:29.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:30.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:30.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:30.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:30.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:31.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:31.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:31.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:31.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:32.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:32.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:32.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:32.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:33.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:33.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:33.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:33.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:34.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:34.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:34.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:34.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:35.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:35.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:35.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:35.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:36.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:36.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:36.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:36.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:37.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:37.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:37.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:37.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:38.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:38.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:38.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:38.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:39.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:39.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:39.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:39.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:40.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:40.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:40.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:40.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:41.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:41.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:41.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:41.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:42.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:42.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:42.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:42.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:43.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:43.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:43.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:43.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:44.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:44.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:44.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:44.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:45.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:45.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:45.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:45.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:46.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:46.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:46.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:46.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:47.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:47.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:47.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:47.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:48.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:48.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:48.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:48.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:49.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:49.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:49.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:49.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:50.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:50.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:50.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:50.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:51.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:51.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:51.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:51.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:52.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:52.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:52.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:52.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:53.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:53.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:53.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:53.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:54.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:54.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:54.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:54.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:55.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:55.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:55.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:55.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:56.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:56.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:56.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:56.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:57.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:57.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:57.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:57.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:58.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:58.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:58.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:58.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:59.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:05:59.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:05:59.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:05:59.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:00.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:00.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:00.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:00.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:01.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:01.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:01.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:01.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:02.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:02.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:02.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:02.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:03.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:03.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:03.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:03.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:04.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:04.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:04.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:04.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:05.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:05.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:05.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:05.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:06.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:06.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:06.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:06.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:07.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:07.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:07.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:07.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:08.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:08.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:08.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:08.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:09.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:09.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:09.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:09.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:10.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:10.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:10.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:10.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:11.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:11.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:11.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:11.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:12.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:12.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:12.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:12.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:13.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:13.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:13.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:13.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:14.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:14.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:14.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:14.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:15.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:15.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:15.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:15.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:16.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:16.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:16.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:16.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:17.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:17.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:17.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:17.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:18.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:18.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:18.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:18.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:19.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:19.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:19.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:19.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:20.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:20.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:20.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:20.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:21.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:21.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:21.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:21.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:22.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:22.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:22.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:22.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:23.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:23.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:23.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:23.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:24.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:24.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:24.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:24.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:25.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:25.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:25.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:25.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:26.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:26.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:26.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:26.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:27.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:27.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:27.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:27.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:28.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:28.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:28.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:28.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:29.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:29.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:29.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:29.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:30.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:30.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:30.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:30.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:31.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:31.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:31.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:31.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:32.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:32.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:32.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:32.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:33.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:33.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:33.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:33.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:34.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:34.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:34.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:34.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:35.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:35.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:35.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:35.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:36.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:36.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:36.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:36.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:37.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:37.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:37.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:37.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:38.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:38.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:38.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:38.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:39.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:39.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:39.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:39.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:40.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:40.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:40.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:40.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:41.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:41.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:41.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:41.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:42.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:42.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:42.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:42.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:43.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:43.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:43.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:43.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:44.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:44.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:44.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:44.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:45.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:45.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:45.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:45.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:46.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:46.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:46.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:46.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:47.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:47.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:47.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:47.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:48.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:48.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:48.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:48.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:49.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:49.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:49.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:49.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:50.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:50.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:50.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:50.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:51.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:51.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:51.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:51.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:52.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:52.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:52.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:52.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:53.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:53.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:53.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:53.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:54.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:54.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:54.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:54.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:55.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:55.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:55.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:55.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:56.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:56.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:56.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:56.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:57.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:57.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:57.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:57.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:58.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:58.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:58.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:58.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:59.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:06:59.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:06:59.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:06:59.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:00.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:00.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:00.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:00.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:01.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:01.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:01.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:01.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:02.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:02.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:02.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:02.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:03.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:03.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:03.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:03.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:04.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:04.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:04.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:04.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:05.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:05.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:05.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:05.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:06.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:06.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:06.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:06.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:07.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:07.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:07.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:07.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:08.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:08.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:08.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:08.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:09.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:09.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:09.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:09.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:10.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:10.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:10.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:10.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:11.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:11.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:11.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:11.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:12.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:12.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:12.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:12.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:13.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:13.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:13.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:13.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:14.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:14.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:14.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:14.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:15.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:15.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:15.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:15.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:16.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:16.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:16.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:16.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:17.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:17.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:17.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:17.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:18.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:18.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:18.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:18.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:19.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:19.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:19.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:19.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:20.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:20.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:20.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:20.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:21.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:21.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:21.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:21.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:22.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:22.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:22.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:22.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:23.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:23.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:23.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:23.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:24.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:24.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:24.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:24.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:25.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:25.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:25.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:25.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:26.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:26.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:26.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:26.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:27.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:27.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:27.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:27.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:28.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:28.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:28.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:28.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:29.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:29.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:29.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:29.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:30.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:30.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:30.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:30.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:31.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:31.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:31.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:31.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:32.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:32.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:32.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:32.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:33.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:33.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:33.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:33.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:34.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:34.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:34.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:34.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:35.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:35.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:35.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:35.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:36.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:36.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:36.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:36.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:37.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:37.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:37.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:37.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:38.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:38.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:38.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:38.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:39.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:39.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:39.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:39.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:40.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:40.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:40.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:40.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:41.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:41.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:41.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:41.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:42.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:42.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:42.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:42.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:43.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:43.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:43.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:43.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:44.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:44.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:44.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:44.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:45.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:45.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:45.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:45.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:46.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:46.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:46.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:46.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:47.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:47.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:47.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:47.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:48.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:48.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:48.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:48.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:49.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:49.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:49.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:49.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:50.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:50.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:50.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:50.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:51.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:51.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:51.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:51.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:52.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:52.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:52.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:52.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:53.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:53.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:53.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:53.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:54.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:54.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:54.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:54.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:55.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:55.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:55.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:55.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:56.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:56.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:56.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:56.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:57.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:57.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:57.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:57.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:58.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:58.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:58.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:58.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:59.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:07:59.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:07:59.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:07:59.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:00.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:00.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:00.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:00.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:01.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:01.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:01.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:01.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:02.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:02.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:02.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:02.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:03.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:03.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:04.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:04.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:04.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:04.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:05.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:05.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:05.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:05.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:06.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:06.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:06.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:06.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:07.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:07.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:07.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:07.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:08.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:08.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:08.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:08.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:09.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:09.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:09.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:09.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:10.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:10.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:10.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:10.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:11.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:10.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:11.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:11.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:12.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:12.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:12.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:12.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:13.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:13.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:13.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:13.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:14.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:14.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:14.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:14.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:15.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:15.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:15.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:15.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:16.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:16.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:16.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:16.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:17.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:17.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:17.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:17.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:18.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:18.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:18.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:18.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:18.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:18.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:19.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:19.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:20.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:20.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:20.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:20.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:21.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:21.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:21.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:21.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:22.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:22.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:22.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:22.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:23.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:23.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:23.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:23.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:24.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:24.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:24.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:24.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:25.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:25.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:25.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:25.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:26.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:26.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:26.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:26.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:27.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:27.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:27.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:27.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:28.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:28.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:28.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:28.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:29.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:29.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:29.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:29.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:30.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:30.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:30.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:30.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:31.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:31.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:31.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:31.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:32.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:32.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:32.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:32.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:33.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:33.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:33.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:33.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:34.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:34.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:34.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:34.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:35.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:35.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:35.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:35.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:36.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:36.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:36.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:36.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:37.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:37.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:37.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:37.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:38.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:38.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:38.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:38.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:39.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:39.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:39.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:39.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:40.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:40.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:40.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:40.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:41.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:41.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:41.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:41.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:42.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:42.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:42.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:42.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:43.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:43.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:43.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:43.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:44.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:44.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:44.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:44.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:45.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:45.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:45.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:45.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:46.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:46.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:46.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:46.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:47.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:47.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:47.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:47.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:48.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:48.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:48.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:48.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:49.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:49.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:49.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:49.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:50.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:50.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:50.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:50.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:51.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:51.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:51.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:51.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:52.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:52.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:52.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:52.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:53.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:53.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:53.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:53.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:54.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:54.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:54.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:54.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:55.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:55.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:55.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:55.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:56.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:56.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:56.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:56.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:57.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:57.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:57.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:57.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:58.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:58.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:58.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:58.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:59.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:08:59.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:08:59.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:08:59.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:00.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:00.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:00.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:00.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:01.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:01.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:01.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:01.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:02.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:02.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:02.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:02.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:03.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:03.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:03.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:03.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:04.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:04.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:04.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:04.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:05.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:05.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:05.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:05.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:06.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:06.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:06.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:06.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:07.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:07.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:07.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:07.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:08.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:08.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:08.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:08.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:09.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:09.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:09.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:09.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:10.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:10.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:10.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:10.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:11.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:11.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:11.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:11.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:12.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:12.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:12.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:12.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:13.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:13.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:13.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:13.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:14.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:14.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:14.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:14.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:15.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:15.304+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:15.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:15.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:16.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:16.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:16.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:16.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:17.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:17.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:17.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:17.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:18.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:18.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:18.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:18.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:19.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:19.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:19.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:19.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:20.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:20.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:20.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:20.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:21.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:21.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:21.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:21.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:22.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:22.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:22.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:22.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:23.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:23.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:23.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:23.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:24.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:24.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:24.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:24.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:25.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:25.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:25.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:25.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:26.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:26.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:26.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:26.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:27.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:27.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:27.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:27.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:28.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:28.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:28.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:28.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:29.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:29.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:29.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:29.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:30.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:30.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:30.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:30.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:31.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:31.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:31.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:31.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:32.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:32.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:32.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:32.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:33.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:33.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:33.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:33.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:34.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:34.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:34.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:34.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:35.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:35.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:35.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:35.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:36.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:36.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:36.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:36.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:37.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:37.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:37.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:37.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:38.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:38.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:38.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:38.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:39.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:39.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:39.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:39.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:40.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:40.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:40.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:40.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:41.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:41.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:41.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:41.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:42.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:42.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:42.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:42.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:43.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:43.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:43.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:43.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:44.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:44.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:44.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:44.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:45.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:45.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:45.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:45.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:46.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:46.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:46.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:46.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:47.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:47.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:47.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:47.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:48.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:48.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:48.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:48.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:49.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:49.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:49.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:49.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:50.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:50.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:50.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:50.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:51.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:51.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:51.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:51.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:52.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:52.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:52.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:52.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:53.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:53.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:53.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:53.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:54.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:54.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:54.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:54.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:55.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:55.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:55.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:55.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:56.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:56.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:56.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:56.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:57.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:57.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:57.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:57.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:58.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:58.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:58.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:58.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:59.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:09:59.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:09:59.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:09:59.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:00.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:00.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:00.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:00.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:01.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:01.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:01.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:01.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:02.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:02.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:02.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:02.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:03.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:03.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:04.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:03.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:04.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:04.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:05.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:04.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:05.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:05.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:06.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:05.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:06.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:06.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:07.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:07.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:07.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:07.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:08.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:08.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:08.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:08.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:09.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:09.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:09.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:09.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:10.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:10.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:10.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:10.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:11.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:11.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:11.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:11.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:12.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:12.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:12.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:12.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:12.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:12.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:13.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:13.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:13.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:13.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:14.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:14.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:14.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:14.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:15.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:15.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:15.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:15.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:16.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:16.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:16.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:16.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:17.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:17.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:17.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:17.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:18.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:18.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:18.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:18.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:19.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:19.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:19.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:19.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:20.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:20.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:20.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:20.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:21.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:21.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:21.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:21.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:22.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:22.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:22.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:22.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:23.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:23.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:23.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:23.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:24.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:24.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:24.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:24.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:25.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:25.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:25.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:25.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:26.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:26.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:26.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:26.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:27.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:27.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:27.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:27.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:28.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:28.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:28.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:28.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:29.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:29.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:29.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:29.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:30.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:30.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:30.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:30.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:31.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:31.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:31.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:31.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:32.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:32.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:32.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:32.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:33.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:33.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:33.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:33.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:34.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:34.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:34.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:34.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:35.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:35.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:35.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:35.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:36.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:36.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:36.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:36.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:37.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:37.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:37.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:37.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:38.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:38.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:38.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:38.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:39.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:39.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:39.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:39.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:40.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:40.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:40.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:40.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:41.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:41.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:41.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:41.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:42.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:42.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:42.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:42.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:43.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:43.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:43.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:43.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:44.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:44.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:44.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:44.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:45.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:45.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:45.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:45.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:46.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:46.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:46.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:46.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:47.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:47.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:47.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:47.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:48.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:48.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:48.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:48.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:49.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:49.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:49.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:49.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:50.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:50.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:50.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:50.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:51.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:51.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:51.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:51.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:52.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:52.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:52.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:52.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:53.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:53.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:53.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:53.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:54.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:54.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:54.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:54.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:55.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:55.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:55.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:55.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:56.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:56.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:56.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:56.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:57.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:57.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:57.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:57.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:58.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:58.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:58.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:58.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:59.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:10:59.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:10:59.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:10:59.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:00.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:00.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:00.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:00.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:01.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:01.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:01.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:01.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:02.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:02.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:02.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:02.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:03.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:03.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:03.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:03.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:04.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:04.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:04.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:04.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:05.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:05.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:05.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:05.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:06.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:06.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:06.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:06.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:07.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:07.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:07.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:07.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:08.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:08.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:08.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:08.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:09.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:09.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:09.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:09.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:10.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:10.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:10.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:10.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:11.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:11.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:11.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:11.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:12.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:12.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:12.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:12.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:13.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:13.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:13.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:13.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:14.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:14.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:14.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:14.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:15.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:15.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:15.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:15.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:16.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:16.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:16.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:16.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:17.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:17.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:17.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:17.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:18.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:18.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:18.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:18.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:19.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:19.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:19.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:19.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:20.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:20.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:20.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:20.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:21.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:21.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:21.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:21.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:22.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:22.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:22.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:22.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:23.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:23.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:23.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:23.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:24.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:24.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:24.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:24.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:25.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:25.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:25.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:25.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:26.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:26.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:26.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:26.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:27.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:27.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:27.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:27.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:28.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:28.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:28.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:28.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:29.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:29.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:29.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:29.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:30.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:30.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:30.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:30.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:31.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:31.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:31.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:31.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:32.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:32.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:32.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:32.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:33.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:33.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:33.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:33.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:34.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:34.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:34.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:34.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:35.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:35.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:35.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:35.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:36.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:36.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:36.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:36.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:37.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:37.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:37.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:37.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:38.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:38.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:38.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:38.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:39.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:39.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:39.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:39.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:40.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:40.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:40.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:40.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:41.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:41.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:41.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:41.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:42.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:42.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:42.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:42.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:43.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:43.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:43.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:43.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:44.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:44.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:44.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:44.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:45.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:45.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:45.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:45.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:46.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:46.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:46.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:46.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:47.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:47.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:47.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:47.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:48.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:48.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:48.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:48.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:49.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:49.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:49.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:49.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:50.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:50.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:50.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:50.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:51.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:51.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:51.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:51.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:52.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:52.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:52.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:52.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:53.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:53.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:53.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:53.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:54.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:54.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:54.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:54.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:55.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:55.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:55.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:55.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:56.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:56.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:56.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:56.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:57.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:57.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:57.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:57.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:58.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:58.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:58.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:58.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:59.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:11:59.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:11:59.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:11:59.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:00.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:00.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:00.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:00.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:01.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:01.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:01.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:01.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:02.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:02.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:02.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:02.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:03.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:03.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:03.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:03.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:04.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:04.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:04.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:04.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:05.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:05.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:05.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:05.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:06.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:06.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:06.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:06.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:07.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:07.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:07.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:07.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:08.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:08.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:08.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:08.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:09.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:09.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:09.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:09.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:10.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:10.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:10.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:10.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:11.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:11.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:11.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:11.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:12.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:12.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:12.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:12.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:13.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:13.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:13.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:13.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:14.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:14.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:14.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:14.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:15.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:15.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:15.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:15.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:16.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:16.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:16.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:16.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:17.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:17.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:17.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:17.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:18.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:18.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:18.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:18.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:19.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:19.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:19.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:19.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:20.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:20.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:20.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:20.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:21.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:21.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:21.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:21.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:22.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:22.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:22.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:22.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:23.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:23.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:23.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:23.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:24.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:24.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:24.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:24.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:25.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:25.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:25.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:25.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:26.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:26.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:26.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:26.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:27.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:27.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:27.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:27.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:28.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:28.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:28.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:28.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:29.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:29.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:29.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:29.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:30.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:30.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:30.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:30.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:31.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:31.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:31.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:31.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:32.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:32.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:32.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:32.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:33.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:33.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:33.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:33.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:34.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:34.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:34.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:34.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:35.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:35.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:35.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:35.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:36.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:36.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:36.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:36.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:37.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:37.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:37.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:37.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:38.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:38.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:38.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:38.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:39.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:39.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:39.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:39.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:40.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:40.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:40.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:40.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:41.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:41.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:41.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:41.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:42.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:42.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:42.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:42.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:43.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:43.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:43.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:43.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:44.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:44.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:44.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:44.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:45.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:45.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:45.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:45.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:46.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:46.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:46.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:46.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:47.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:47.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:47.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:47.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:48.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:48.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:48.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:48.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:49.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:49.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:49.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:49.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:50.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:50.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:50.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:50.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:51.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:51.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:51.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:51.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:52.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:52.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:52.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:52.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:53.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:53.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:53.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:53.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:54.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:54.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:54.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:54.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:55.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:55.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:55.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:55.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:56.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:56.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:56.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:56.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:57.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:57.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:57.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:57.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:58.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:58.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:58.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:58.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:59.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:12:59.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:12:59.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:12:59.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:00.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:00.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:00.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:00.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:01.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:01.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:01.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:01.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:02.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:02.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:02.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:02.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:03.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:03.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:03.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:03.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:04.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:04.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:04.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:04.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:05.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:05.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:05.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:05.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:06.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:06.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:06.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:06.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:07.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:07.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:07.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:07.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:08.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:08.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:08.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:08.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:09.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:09.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:09.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:09.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:10.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:10.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:10.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:10.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:11.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:11.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:11.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:11.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:12.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:12.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:12.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:12.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:13.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:13.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:13.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:13.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:14.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:14.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:14.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:14.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:15.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:15.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:15.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:15.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:16.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:16.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:16.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:16.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:17.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:17.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:17.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:17.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:18.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:18.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:18.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:18.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:19.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:19.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:19.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:19.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:20.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:20.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:20.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:20.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:21.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:21.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:21.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:21.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:22.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:22.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:22.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:22.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:23.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:23.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:23.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:23.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:24.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:24.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:24.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:24.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:25.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:25.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:25.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:25.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:26.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:26.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:26.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:26.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:27.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:27.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:27.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:27.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:28.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:28.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:28.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:28.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:29.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:29.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:29.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:29.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:30.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:30.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:31.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:31.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:31.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:31.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:32.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:32.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:32.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:32.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:33.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:33.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:33.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:33.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:33.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:33.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:34.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:34.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:34.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:34.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:35.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:35.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:35.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:35.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:36.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:36.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:36.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:36.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:37.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:37.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:37.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:37.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:38.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:38.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:38.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:38.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:39.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:39.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:39.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:39.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:40.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:40.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:40.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:40.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:41.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:41.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:41.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:41.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:42.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:42.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:42.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:42.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:43.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:43.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:43.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:43.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:44.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:44.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:45.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:45.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:45.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:45.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:45.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:45.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:46.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:46.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:47.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:47.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:47.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:47.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:48.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:48.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:48.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:48.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:49.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:49.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:49.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:49.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:50.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:50.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:50.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:50.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:51.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:51.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:51.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:51.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:52.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:52.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:52.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:52.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:53.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:53.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:53.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:53.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:54.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:54.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:54.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:54.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:55.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:55.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:55.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:55.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:56.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:56.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:56.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:56.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:57.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:57.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:57.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:57.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:58.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:58.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:58.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:58.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:59.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:13:59.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:13:59.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:13:59.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:00.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:00.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:00.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:01.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:01.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:01.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:01.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:02.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:02.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:02.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:02.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:03.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:03.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:03.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:03.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:04.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:04.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:04.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:04.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:05.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:05.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:05.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:05.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:06.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:06.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:06.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:06.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:07.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:07.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:07.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:07.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:08.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:08.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:08.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:08.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:09.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:09.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:09.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:09.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:10.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:10.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:10.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:10.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:11.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:11.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:11.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:11.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:12.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:12.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:12.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:12.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:13.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:13.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:13.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:13.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:14.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:14.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:14.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:14.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:15.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:15.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:15.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:15.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:16.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:16.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:16.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:16.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:17.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:17.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:17.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:17.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:18.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:18.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:18.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:18.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:19.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:19.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:19.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:19.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:20.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:20.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:20.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:20.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:21.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:21.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:21.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:21.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:22.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:22.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:22.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:22.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:23.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:23.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:23.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:23.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:24.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:24.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:24.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:24.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:25.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:25.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:25.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:25.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:26.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:26.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:26.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:26.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:27.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:27.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:27.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:27.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:28.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:28.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:28.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:28.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:29.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:29.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:29.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:29.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:30.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:30.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:30.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:30.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:31.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:31.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:31.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:31.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:32.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:32.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:32.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:32.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:33.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:33.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:33.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:33.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:34.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:34.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:34.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:34.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:35.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:35.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:35.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:35.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:36.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:36.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:36.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:36.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:37.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:37.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:37.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:37.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:38.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:38.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:38.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:38.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:39.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:39.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:39.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:39.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:40.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:40.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:40.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:40.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:41.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:41.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:41.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:41.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:42.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:42.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:42.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:42.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:43.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:43.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:43.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:43.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:44.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:44.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:44.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:44.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:45.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:45.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:45.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:45.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:46.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:46.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:46.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:46.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:47.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:47.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:47.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:47.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:48.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:48.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:48.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:48.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:49.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:49.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:49.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:49.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:50.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:50.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:50.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:50.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:51.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:51.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:51.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:51.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:52.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:52.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:52.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:52.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:53.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:53.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:53.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:53.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:54.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:54.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:54.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:54.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:55.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:55.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:55.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:55.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:56.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:56.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:56.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:56.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:57.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:57.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:57.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:57.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:58.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:58.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:58.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:58.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:59.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:14:59.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:14:59.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:14:59.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:00.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:00.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:00.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:00.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:01.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:01.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:01.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:01.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:02.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:02.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:02.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:02.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:03.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:03.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:03.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:03.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:04.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:04.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:04.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:04.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:05.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:05.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:05.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:05.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:06.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:06.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:06.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:06.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:07.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:07.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:07.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:07.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:08.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:08.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:08.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:08.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:09.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:09.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:09.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:09.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:10.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:10.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:10.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:10.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:11.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:11.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:11.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:11.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:12.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:12.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:12.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:12.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:13.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:13.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:13.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:13.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:14.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:14.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:14.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:14.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:15.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:15.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:15.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:15.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:16.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:16.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:16.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:16.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:17.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:17.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:17.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:17.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:18.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:18.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:18.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:18.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:19.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:19.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:19.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:19.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:20.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:20.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:20.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:20.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:21.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:21.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:21.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:21.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:22.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:22.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:22.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:22.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:23.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:23.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:23.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:23.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:24.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:24.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:24.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:24.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:25.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:25.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:25.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:25.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:26.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:26.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:26.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:26.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:27.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:27.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:27.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:27.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:28.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:28.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:28.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:28.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:29.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:29.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:29.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:29.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:30.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:30.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:30.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:30.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:31.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:31.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:31.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:31.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:32.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:32.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:32.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:32.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:33.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:33.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:33.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:33.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:34.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:34.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:34.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:34.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:35.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:35.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:35.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:35.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:36.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:36.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:36.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:36.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:37.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:37.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:37.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:37.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:38.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:38.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:38.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:38.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:39.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:39.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:39.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:39.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:40.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:40.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:40.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:40.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:41.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:41.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:41.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:41.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:42.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:42.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:42.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:42.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:43.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:43.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:43.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:43.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:44.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:44.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:44.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:44.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:45.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:45.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:45.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:45.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:46.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:46.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:46.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:46.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:47.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:47.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:47.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:47.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:48.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:48.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:48.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:48.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:49.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:49.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:49.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:49.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:50.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:50.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:50.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:50.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:51.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:51.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:51.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:51.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:52.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:52.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:52.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:52.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:53.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:53.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:53.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:53.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:54.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:54.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:54.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:54.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:55.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:55.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:55.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:55.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:56.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:56.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:56.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:56.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:57.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:57.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:57.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:57.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:58.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:58.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:58.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:58.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:59.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:15:59.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:15:59.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:15:59.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:00.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:00.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:00.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:00.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:01.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:01.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:01.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:01.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:02.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:02.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:02.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:02.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:03.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:03.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:03.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:03.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:04.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:04.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:04.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:04.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:05.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:05.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:05.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:05.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:06.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:06.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:06.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:06.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:07.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:07.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:07.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:07.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:08.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:08.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:08.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:08.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:09.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:09.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:09.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:09.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:10.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:10.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:10.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:10.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:11.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:11.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:11.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:11.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:12.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:12.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:12.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:12.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:13.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:13.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:13.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:13.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:14.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:14.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:14.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:14.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:15.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:15.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:15.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:15.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:16.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:16.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:16.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:16.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:17.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:17.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:17.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:17.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:18.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:18.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:18.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:18.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:19.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:19.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:19.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:19.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:20.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:20.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:20.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:20.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:21.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:21.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:21.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:21.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:22.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:22.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:22.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:22.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:23.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:23.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:23.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:23.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:24.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:24.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:24.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:24.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:25.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:25.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:25.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:25.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:26.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:26.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:26.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:26.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:27.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:27.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:27.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:27.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:28.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:28.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:28.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:28.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:29.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:29.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:29.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:29.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:30.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:30.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:30.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:30.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:31.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:31.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:31.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:31.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:32.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:32.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:32.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:32.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:33.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:33.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:33.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:33.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:34.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:34.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:34.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:34.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:35.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:35.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:35.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:35.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:36.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:36.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:36.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:36.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:37.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:37.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:37.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:37.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:38.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:38.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:38.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:38.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:39.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:39.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:39.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:39.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:40.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:40.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:40.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:40.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:41.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:41.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:41.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:41.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:42.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:42.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:42.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:42.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:43.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:43.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:43.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:43.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:44.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:44.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:44.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:44.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:45.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:45.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:45.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:45.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:46.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:46.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:46.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:46.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:47.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:47.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:47.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:47.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:48.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:48.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:48.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:48.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:49.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:49.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:49.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:49.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:50.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:50.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:50.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:50.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:51.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:51.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:51.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:51.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:52.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:52.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:52.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:52.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:53.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:53.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:53.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:53.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:54.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:54.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:54.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:54.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:55.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:55.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:55.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:55.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:56.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:56.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:56.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:56.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:57.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:57.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:57.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:57.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:58.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:58.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:58.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:58.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:59.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:16:59.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:16:59.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:16:59.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:00.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:00.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:00.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:00.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:01.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:01.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:01.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:01.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:02.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:02.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:02.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:02.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:03.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:03.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:03.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:03.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:04.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:04.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:04.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:04.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:05.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:05.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:05.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:05.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:06.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:06.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:06.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:06.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:07.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:07.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:07.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:07.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:08.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:08.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:08.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:08.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:09.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:09.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:09.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:09.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:10.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:10.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:10.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:10.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:11.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:11.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:11.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:11.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:12.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:12.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:12.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:12.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:13.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:13.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:13.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:13.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:14.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:14.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:14.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:14.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:15.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:15.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:15.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:15.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:16.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:16.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:16.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:16.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:17.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:17.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:17.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:17.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:18.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:18.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:18.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:18.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:19.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:19.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:19.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:19.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:20.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:20.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:20.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:20.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:21.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:21.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:21.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:21.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:22.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:22.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:22.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:22.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:23.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:23.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:23.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:23.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:24.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:24.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:24.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:24.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:25.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:25.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:25.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:25.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:26.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:26.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:26.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:26.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:27.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:27.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:27.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:27.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:28.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:28.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:28.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:28.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:29.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:29.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:29.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:29.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:30.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:30.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:30.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:30.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:31.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:31.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:31.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:31.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:32.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:32.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:32.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:32.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:33.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:33.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:33.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:33.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:34.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:34.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:34.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:34.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:35.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:35.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:35.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:35.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:36.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:36.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:36.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:36.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:37.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:37.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:37.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:37.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:38.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:38.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:38.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:38.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:39.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:39.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:39.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:39.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:40.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:40.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:40.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:40.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:41.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:41.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:41.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:41.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:42.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:42.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:42.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:42.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:43.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:43.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:43.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:43.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:44.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:44.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:44.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:44.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:45.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:45.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:45.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:45.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:46.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:46.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:46.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:46.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:47.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:47.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:47.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:47.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:48.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:48.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:48.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:48.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:49.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:49.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:49.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:49.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:50.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:50.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:50.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:50.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:51.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:51.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:51.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:51.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:52.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:52.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:52.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:52.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:53.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:53.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:53.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:53.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:54.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:54.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:54.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:54.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:55.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:55.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:55.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:55.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:56.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:56.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:56.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:56.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:57.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:57.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:57.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:57.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:58.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:58.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:58.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:58.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:59.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:17:59.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:17:59.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:17:59.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:00.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:00.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:00.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:00.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:01.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:01.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:01.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:01.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:02.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:02.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:02.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:02.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:03.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:03.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:03.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:03.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:04.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:04.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:04.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:04.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:05.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:05.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:05.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:05.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:06.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:06.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:06.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:06.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:07.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:07.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:07.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:07.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:08.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:08.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:08.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:08.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:09.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:09.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:09.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:09.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:10.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:10.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:10.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:10.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:11.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:11.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:11.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:11.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:12.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:12.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:12.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:12.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:13.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:13.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:13.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:13.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:14.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:14.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:14.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:14.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:15.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:15.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:15.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:15.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:16.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:16.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:16.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:16.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:17.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:17.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:17.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:17.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:18.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:18.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:18.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:18.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:19.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:19.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:19.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:19.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:20.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:20.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:20.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:20.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:21.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:21.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:21.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:21.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:22.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:22.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:22.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:22.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:23.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:23.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:23.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:23.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:24.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:24.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:24.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:24.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:25.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:25.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:25.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:25.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:26.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:26.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:26.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:26.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:27.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:27.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:27.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:27.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:28.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:28.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:28.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:28.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:29.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:29.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:29.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:29.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:30.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:30.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:30.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:30.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:31.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:31.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:31.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:31.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:32.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:32.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:32.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:32.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:33.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:33.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:33.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:33.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:34.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:34.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:34.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:34.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:35.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:35.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:35.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:35.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:36.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:36.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:36.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:36.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:37.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:37.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:37.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:37.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:38.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:38.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:38.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:38.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:39.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:39.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:39.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:39.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:40.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:40.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:40.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:40.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:41.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:41.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:42.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:42.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:42.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:42.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:43.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:42.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:43.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:43.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:44.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:43.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:44.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:44.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:45.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:44.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:45.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:45.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:46.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:46.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:46.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:46.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:47.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:47.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:47.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:47.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:48.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:48.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:48.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:48.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:49.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:49.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:49.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:49.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:50.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:50.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:50.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:50.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:51.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:51.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:51.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:51.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:52.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:52.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:52.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:52.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:53.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:53.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:53.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:53.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:54.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:54.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:54.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:54.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:55.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:55.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:55.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:55.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:56.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:56.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:56.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:56.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:57.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:57.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:57.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:57.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:58.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:58.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:58.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:58.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:59.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:18:59.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:18:59.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:18:59.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:00.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:00.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:00.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:00.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:01.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:01.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:01.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:01.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:01.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:01.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:02.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:02.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:02.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:02.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:03.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:03.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:03.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:03.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:04.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:04.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:04.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:04.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:05.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:05.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:05.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:05.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:06.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:06.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:06.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:06.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:07.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:07.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:07.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:07.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:08.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:08.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:08.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:08.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:09.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:09.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:09.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:09.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:10.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:10.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:10.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:10.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:11.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:11.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:12.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:12.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:12.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:12.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:12.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:12.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:13.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:13.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:13.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:13.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:14.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:14.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:15.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:15.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:15.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:15.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:15.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:15.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:16.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:16.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:16.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:16.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:17.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:17.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:17.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:17.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:18.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:18.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:18.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:18.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:19.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:19.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:20.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:20.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:20.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:20.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:21.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:21.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:21.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:21.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:22.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:22.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:22.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:22.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:23.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:23.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:23.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:23.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:24.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:24.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:24.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:24.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:25.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:25.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:25.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:25.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:26.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:26.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:26.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:26.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:27.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:27.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:27.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:27.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:28.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:28.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:28.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:28.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:29.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:29.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:29.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:29.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:30.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:30.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:30.941 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:30.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:31.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:31.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:31.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:31.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:32.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:32.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:32.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:32.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:32.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:32.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:33.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:33.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:33.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:33.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:34.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:34.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:35.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:35.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:35.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:35.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:36.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:36.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:36.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:36.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:37.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:37.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:37.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:37.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:38.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:38.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:38.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:38.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:39.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:39.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:39.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:39.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:40.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:40.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:40.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:40.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:41.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:41.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:41.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:41.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:42.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:42.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:42.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:42.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:43.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:43.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:43.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:43.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:44.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:44.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:44.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:44.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:45.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:45.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:45.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:45.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:46.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:46.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:46.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:46.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:47.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:47.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:47.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:47.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:48.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:48.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:48.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:48.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:49.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:49.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:49.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:49.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:50.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:50.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:50.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:50.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:51.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:51.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:51.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:51.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:52.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:52.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:52.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:52.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:53.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:53.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:53.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:53.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:54.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:54.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:54.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:54.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:55.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:55.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:55.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:55.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:56.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:56.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:56.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:56.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:57.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:57.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:57.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:57.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:58.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:58.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:58.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:58.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:59.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:19:59.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:19:59.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:19:59.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:00.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:00.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:00.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:00.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:01.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:01.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:01.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:01.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:01.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:01.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:02.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:02.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:02.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:02.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:03.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:03.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:03.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:03.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:04.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:04.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:04.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:04.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:05.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:05.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:05.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:05.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:06.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:06.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:06.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:06.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:07.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:07.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:07.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:07.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:08.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:08.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:08.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:08.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:09.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:09.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:10.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:10.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:10.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:10.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:11.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:11.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:11.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:11.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:12.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:12.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:12.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:12.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:13.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:13.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:13.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:13.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:14.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:14.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:14.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:14.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:15.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:15.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:15.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:15.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:16.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:16.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:16.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:16.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:17.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:17.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:17.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:17.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:18.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:18.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:18.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:18.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:19.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:19.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:19.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:19.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:20.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:20.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:20.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:20.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:21.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:21.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:21.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:21.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:22.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:22.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:22.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:22.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:23.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:23.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:23.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:23.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:24.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:24.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:24.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:24.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:25.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:25.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:25.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:25.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:25.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:25.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:26.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:26.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:26.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:26.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:27.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:27.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:27.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:27.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:28.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:28.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:28.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:28.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:29.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:29.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:29.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:29.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:30.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:30.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:30.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:30.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:31.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:31.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:32.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:32.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:32.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:32.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:33.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:33.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:33.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:33.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:34.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:34.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:34.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:34.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:35.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:35.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:35.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:35.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:36.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:36.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:36.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:36.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:37.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:37.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:37.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:37.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:38.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:38.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:38.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:38.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:39.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:39.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:39.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:39.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:40.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:39.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:40.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:40.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:41.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:41.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:41.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:41.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:42.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:42.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:42.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:42.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:43.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:43.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:43.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:43.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:44.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:44.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:44.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:44.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:45.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:45.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:46.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:46.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:46.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:46.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:46.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:46.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:47.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:47.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:47.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:47.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:48.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:48.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:49.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:48.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:49.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:49.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:50.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:50.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:50.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:50.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:51.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:51.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:51.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:51.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:51.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:51.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:52.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:52.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:52.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:52.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:53.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:53.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:53.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:53.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:54.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:54.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:54.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:54.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:55.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:55.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:55.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:55.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:56.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:56.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:56.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:56.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:57.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:57.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:57.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:57.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:58.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:58.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:58.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:58.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:59.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:20:59.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:20:59.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:20:59.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:00.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:00.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:00.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:00.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:01.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:01.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:01.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:01.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:02.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:02.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:02.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:02.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:03.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:03.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:03.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:03.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:04.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:04.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:04.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:04.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:05.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:05.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:05.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:05.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:06.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:06.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:06.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:06.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:07.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:07.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:07.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:07.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:08.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:08.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:08.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:08.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:09.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:09.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:09.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:09.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:10.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:10.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:10.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:10.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:11.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:11.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:11.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:11.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:12.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:12.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:12.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:12.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:13.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:13.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:13.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:13.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:14.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:14.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:14.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:14.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:15.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:15.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:15.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:15.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:16.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:16.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:16.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:16.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:17.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:17.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:17.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:17.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:18.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:18.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:18.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:18.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:19.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:19.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:19.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:19.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:20.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:20.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:20.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:20.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:21.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:21.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:21.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:21.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:22.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:22.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:22.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:22.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:23.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:23.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:23.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:23.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:24.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:24.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:24.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:24.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:25.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:25.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:25.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:25.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:26.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:26.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:26.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:26.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:27.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:27.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:27.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:27.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:28.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:28.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:28.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:28.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:29.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:29.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:29.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:29.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:30.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:30.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:30.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:30.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:31.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:31.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:31.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:31.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:32.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:32.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:32.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:32.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:33.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:33.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:33.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:33.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:34.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:34.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:34.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:34.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:35.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:35.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:35.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:35.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:36.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:36.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:36.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:36.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:37.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:37.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:37.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:37.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:38.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:38.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:38.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:38.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:39.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:39.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:39.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:39.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:40.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:40.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:40.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:40.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:41.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:41.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:41.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:41.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:42.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:42.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:42.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:42.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:43.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:43.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:43.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:43.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:44.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:44.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:44.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:44.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:45.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:45.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:45.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:45.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:46.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:46.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:46.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:46.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:47.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:47.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:47.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:47.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:48.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:48.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:48.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:48.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:49.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:49.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:49.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:49.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:50.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:50.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:50.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:50.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:51.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:51.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:51.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:51.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:52.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:52.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:52.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:52.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:53.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:53.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:53.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:53.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:54.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:54.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:54.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:54.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:55.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:55.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:55.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:55.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:56.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:56.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:56.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:56.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:57.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:57.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:57.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:57.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:58.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:58.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:58.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:58.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:59.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:21:59.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:21:59.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:21:59.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:00.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:00.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:00.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:00.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:01.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:01.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:01.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:01.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:02.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:02.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:02.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:02.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:03.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:03.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:03.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:03.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:04.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:04.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:04.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:04.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:05.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:05.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:05.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:05.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:06.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:06.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:06.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:06.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:07.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:07.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:08.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:08.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:08.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:08.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:09.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:09.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:09.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:09.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:10.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:10.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:10.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:10.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:11.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:11.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:11.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:11.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:12.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:12.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:12.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:12.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:13.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:13.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:13.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:13.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:14.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:14.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:14.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:14.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:15.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:15.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:15.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:15.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:16.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:16.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:16.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:16.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:17.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:17.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:17.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:17.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:18.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:18.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:18.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:18.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:19.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:19.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:19.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:19.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:20.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:20.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:20.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:20.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:21.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:21.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:21.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:21.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:22.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:22.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:22.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:22.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:23.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:23.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:23.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:23.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:24.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:24.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:24.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:24.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:25.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:25.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:25.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:25.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:25.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:25.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:26.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:26.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:27.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:27.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:27.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:27.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:28.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:28.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:28.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:28.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:29.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:29.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:29.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:29.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:30.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:30.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:30.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:30.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:31.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:31.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:31.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:31.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:32.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:32.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:32.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:32.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:33.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:33.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:33.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:33.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:34.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:34.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:34.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:34.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:35.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:35.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:35.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:35.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:36.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:36.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:36.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:36.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:37.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:37.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:37.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:37.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:38.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:38.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:38.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:38.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:39.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:39.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:39.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:39.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:39.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:39.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:40.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:40.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:41.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:41.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:41.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:41.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:42.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:42.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:42.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:42.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:43.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:43.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:43.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:43.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:44.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:44.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:44.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:44.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:45.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:45.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:45.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:45.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:46.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:46.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:46.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:46.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:47.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:47.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:47.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:47.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:48.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:48.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:48.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:48.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:49.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:49.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:49.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:49.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:50.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:50.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:50.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:50.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:51.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:51.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:51.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:51.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:52.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:52.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:52.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:52.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:53.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:53.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:53.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:53.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:54.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:54.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:54.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:54.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:55.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:55.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:55.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:55.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:56.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:56.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:56.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:56.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:57.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:57.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:57.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:57.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:58.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:58.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:58.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:58.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:59.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:22:59.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:22:59.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:22:59.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:00.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:00.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:00.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:00.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:01.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:01.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:01.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:01.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:02.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:02.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:02.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:02.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:03.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:03.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:03.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:03.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:04.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:04.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:04.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:04.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:05.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:05.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:05.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:05.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:06.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:06.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:06.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:06.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:07.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:07.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:07.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:07.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:08.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:08.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:08.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:08.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:09.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:09.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:09.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:09.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:10.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:10.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:10.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:10.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:11.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:11.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:11.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:11.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:12.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:12.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:12.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:12.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:13.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:13.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:13.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:13.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:14.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:14.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:14.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:14.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:15.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:15.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:15.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:15.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:16.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:16.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:16.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:16.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:17.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:17.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:17.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:17.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:18.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:18.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:18.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:18.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:19.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:19.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:19.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:19.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:20.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:20.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:20.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:20.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:21.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:21.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:21.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:21.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:22.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:22.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:22.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:22.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:23.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:23.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:23.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:23.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:24.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:24.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:24.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:24.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:25.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:25.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:25.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:25.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:26.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:26.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:26.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:26.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:27.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:27.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:27.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:27.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:28.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:28.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:28.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:28.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:29.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:29.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:29.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:29.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:30.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:30.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:30.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:30.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:31.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:31.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:31.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:31.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:32.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:32.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:32.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:32.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:33.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:33.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:33.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:33.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:34.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:34.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:34.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:34.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:35.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:35.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:35.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:35.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:36.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:36.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:36.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:36.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:37.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:37.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:37.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:37.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:38.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:38.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:38.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:38.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:39.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:39.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:39.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:39.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:40.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:40.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:40.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:40.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:41.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:41.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:41.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:41.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:42.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:42.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:42.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:42.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:43.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:43.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:43.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:43.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:44.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:44.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:44.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:44.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:45.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:45.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:45.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:45.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:46.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:46.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:46.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:46.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:47.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:47.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:47.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:47.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:48.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:48.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:48.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:48.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:49.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:49.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:49.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:49.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:50.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:50.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:50.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:50.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:51.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:51.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:51.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:51.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:52.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:52.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:52.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:52.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:53.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:53.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:53.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:53.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:54.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:54.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:54.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:54.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:55.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:55.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:55.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:55.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:56.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:56.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:56.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:56.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:57.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:57.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:57.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:57.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:58.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:58.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:58.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:58.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:59.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:23:59.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:23:59.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:23:59.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:00.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:00.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:00.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:00.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:01.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:01.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:01.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:01.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:02.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:02.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:02.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:02.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:03.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:03.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:03.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:03.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:04.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:04.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:04.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:04.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:05.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:05.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:05.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:05.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:06.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:06.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:06.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:06.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:07.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:07.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:07.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:07.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:08.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:08.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:08.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:08.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:09.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:09.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:09.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:09.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:10.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:10.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:10.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:10.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:11.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:11.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:11.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:11.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:12.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:12.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:12.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:12.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:13.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:13.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:13.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:13.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:14.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:14.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:14.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:14.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:15.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:15.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:15.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:15.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:16.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:16.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:16.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:16.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:17.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:17.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:17.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:17.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:18.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:18.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:18.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:18.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:19.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:19.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:19.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:19.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:20.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:20.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:20.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:20.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:21.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:21.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:21.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:21.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:22.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:22.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:22.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:22.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:23.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:23.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:23.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:23.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:23.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:23.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:24.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:24.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:24.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:24.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:25.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:25.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:26.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:26.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:26.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:26.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:27.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:26.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:27.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:27.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:27.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:27.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:28.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:28.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:28.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:28.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:29.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:29.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:30.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:30.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:30.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:30.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:31.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:31.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:31.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:31.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:32.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:32.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:32.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:32.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:33.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:33.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:33.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:33.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:34.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:34.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:34.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:34.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:35.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:35.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:35.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:35.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:36.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:36.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:36.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:36.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:37.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:37.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:37.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:37.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:38.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:38.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:38.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:38.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:39.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:39.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:39.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:39.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:40.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:40.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:40.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:40.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:41.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:41.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:41.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:41.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:42.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:42.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:42.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:42.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:43.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:43.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:43.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:43.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:44.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:44.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:44.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:44.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:45.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:45.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:45.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:45.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:46.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:46.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:46.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:46.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:47.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:46.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:47.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:47.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:48.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:48.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:48.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:48.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:49.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:49.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:49.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:49.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:50.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:50.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:50.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:50.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:51.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:51.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:51.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:51.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:52.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:52.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:52.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:52.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:53.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:53.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:53.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:53.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:54.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:54.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:54.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:54.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:55.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:55.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:55.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:55.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:56.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:56.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:56.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:56.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:57.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:57.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:57.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:57.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:58.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:58.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:58.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:58.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:59.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:24:59.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:24:59.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:24:59.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:00.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:00.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:00.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:00.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:01.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:01.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:01.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:01.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:02.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:02.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:02.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:02.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:03.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:03.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:03.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:03.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:04.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:04.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:04.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:04.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:05.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:05.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:05.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:05.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:06.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:06.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:06.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:06.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:07.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:07.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:07.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:07.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:08.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:08.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:08.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:08.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:09.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:09.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:09.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:09.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:10.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:10.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:10.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:10.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:11.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:11.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:11.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:11.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:12.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:12.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:12.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:12.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:13.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:13.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:13.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:13.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:14.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:14.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:14.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:14.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:15.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:15.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:15.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:15.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:16.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:16.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:16.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:16.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:17.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:17.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:17.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:17.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:18.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:18.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:18.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:18.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:19.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:19.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:19.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:19.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:20.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:20.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:20.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:20.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:21.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:21.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:21.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:21.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:22.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:22.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:22.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:22.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:23.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:23.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:23.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:23.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:24.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:24.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:24.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:24.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:25.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:25.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:25.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:25.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:26.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:26.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:26.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:26.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:27.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:27.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:27.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:27.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:28.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:28.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:28.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:28.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:29.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:29.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:29.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:29.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:30.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:30.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:30.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:30.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:31.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:31.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:31.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:31.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:32.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:32.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:32.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:32.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:33.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:33.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:33.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:33.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:34.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:34.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:34.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:34.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:35.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:35.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:35.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:35.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:36.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:36.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:36.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:36.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:37.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:37.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:37.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:37.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:38.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:38.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:38.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:38.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:39.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:39.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:39.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:39.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:40.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:40.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:40.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:40.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:41.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:41.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:41.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:41.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:42.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:42.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:42.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:42.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:43.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:43.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:43.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:43.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:44.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:44.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:44.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:44.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:45.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:45.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:45.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:45.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:46.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:46.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:46.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:46.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:47.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:47.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:47.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:47.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:48.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:48.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:48.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:48.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:49.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:49.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:49.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:49.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:50.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:50.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:50.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:50.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:51.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:51.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:51.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:51.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:52.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:52.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:52.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:52.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:53.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:53.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:53.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:53.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:54.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:54.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:54.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:54.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:55.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:55.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:55.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:55.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:56.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:56.029+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:56.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:56.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:57.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:57.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:57.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:57.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:58.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:58.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:58.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:58.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:59.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:25:59.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:25:59.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:25:59.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:00.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:00.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:00.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:00.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:01.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:01.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:01.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:01.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:02.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:02.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:02.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:02.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:03.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:03.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:03.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:03.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:04.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:04.057+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:04.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:04.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:05.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:05.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:05.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:05.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:06.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:06.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:06.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:06.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:07.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:07.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:07.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:07.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:08.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:08.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:08.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:08.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:09.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:09.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:09.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:09.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:10.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:10.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:10.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:10.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:11.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:11.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:11.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:11.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:12.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:12.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:12.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:12.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:13.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:13.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:13.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:13.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:14.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:14.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:14.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:14.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:15.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:15.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:15.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:15.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:16.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:16.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:16.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:16.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:17.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:17.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:17.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:17.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:18.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:18.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:18.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:18.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:19.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:19.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:19.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:19.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:20.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:20.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:20.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:20.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:21.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:21.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:21.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:21.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:22.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:22.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:22.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:22.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:23.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:23.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:23.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:23.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:24.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:24.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:24.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:24.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:25.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:25.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:25.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:25.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:26.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:26.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:26.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:26.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:27.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:27.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:27.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:27.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:28.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:28.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:28.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:28.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:29.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:29.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:29.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:29.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:30.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:30.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:30.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:30.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:31.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:31.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:31.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:31.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:32.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:32.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:32.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:32.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:33.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:33.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:33.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:33.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:34.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:34.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:34.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:34.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:35.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:35.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:35.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:35.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:36.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:36.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:36.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:36.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:37.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:37.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:37.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:37.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:38.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:38.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:38.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:38.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:39.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:39.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:39.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:39.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:40.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:40.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:40.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:40.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:41.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:41.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:41.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:41.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:42.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:42.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:42.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:42.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:43.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:43.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:43.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:43.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:44.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:44.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:44.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:44.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:45.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:45.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:45.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:45.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:46.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:46.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:46.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:46.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:47.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:47.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:47.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:47.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:47.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:47.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:48.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:48.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:48.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:48.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:49.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:49.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:49.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:49.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:50.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:50.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:50.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:50.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:51.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:51.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:51.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:51.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:52.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:52.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:52.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:52.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:53.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:53.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:54.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:54.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:54.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:54.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:54.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:54.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:55.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:55.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:55.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:55.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:56.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:56.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:56.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:56.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:57.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:57.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:58.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:57.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:58.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:58.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:59.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:26:59.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:26:59.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:26:59.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:00.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:00.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:00.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:00.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:01.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:01.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:01.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:01.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:02.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:02.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:02.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:02.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:03.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:03.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:03.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:03.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:04.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:04.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:04.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:04.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:05.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:05.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:05.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:05.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:06.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:06.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:06.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:06.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:07.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:07.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:07.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:07.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:08.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:08.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:08.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:08.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:09.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:09.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:09.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:09.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:10.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:10.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:10.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:10.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:11.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:11.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:11.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:11.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:12.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:12.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:12.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:12.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:13.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:13.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:13.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:13.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:14.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:14.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:14.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:14.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:15.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:15.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:15.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:15.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:16.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:16.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:16.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:16.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:17.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:17.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:17.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:17.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:18.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:18.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:18.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:18.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:19.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:19.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:19.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:19.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:20.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:20.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:20.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:20.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:21.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:21.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:21.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:21.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:22.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:22.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:22.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:22.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:23.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:23.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:23.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:23.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:24.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:24.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:24.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:24.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:25.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:25.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:25.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:25.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:26.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:26.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:26.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:26.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:27.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:27.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:27.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:27.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:28.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:28.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:28.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:28.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:29.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:29.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:29.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:29.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:30.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:30.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:30.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:30.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:31.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:31.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:31.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:31.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:32.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:32.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:32.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:32.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:33.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:33.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:33.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:33.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:34.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:34.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:34.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:34.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:35.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:35.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:35.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:35.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:36.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:36.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:36.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:36.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:37.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:37.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:37.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:37.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:38.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:38.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:38.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:38.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:39.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:39.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:39.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:39.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:40.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:40.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:41.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:41.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:41.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:41.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:42.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:42.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:42.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:42.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:43.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:43.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:43.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:43.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:44.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:44.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:44.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:44.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:45.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:45.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:45.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:45.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:46.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:46.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:46.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:46.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:46.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:46.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:47.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:47.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:47.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:47.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:48.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:48.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:48.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:48.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:49.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:49.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:49.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:49.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:50.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:50.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:50.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:50.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:51.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:51.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:51.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:51.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:52.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:52.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:52.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:52.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:53.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:53.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:53.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:53.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:54.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:54.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:54.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:54.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:55.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:55.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:55.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:55.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:56.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:56.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:56.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:56.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:56.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:56.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:57.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:57.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:58.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:58.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:58.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:58.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:59.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:27:59.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:27:59.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:27:59.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:00.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:00.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:01.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:01.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:01.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:01.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:01.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:01.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:02.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:02.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:03.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:03.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:03.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:03.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:04.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:04.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:04.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:04.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:05.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:05.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:05.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:05.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:06.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:06.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:06.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:06.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:07.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:07.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:07.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:07.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:08.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:08.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:08.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:08.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:09.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:09.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:09.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:09.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:10.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:10.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:10.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:10.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:11.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:11.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:11.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:11.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:12.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:12.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:12.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:12.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:13.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:13.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:13.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:13.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:14.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:14.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:14.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:14.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:15.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:15.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:15.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:15.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:16.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:16.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:16.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:16.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:17.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:17.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:17.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:17.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:18.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:18.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:18.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:18.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:19.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:19.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:19.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:19.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:20.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:20.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:20.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:20.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:21.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:21.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:21.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:21.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:22.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:22.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:22.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:22.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:23.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:23.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:23.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:23.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:24.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:24.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:24.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:24.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:25.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:25.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:25.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:25.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:26.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:26.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:26.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:26.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:27.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:27.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:27.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:27.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:28.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:28.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:28.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:28.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:29.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:29.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:29.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:29.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:30.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:30.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:30.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:30.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:31.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:31.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:31.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:31.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:32.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:32.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:32.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:32.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:33.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:33.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:33.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:33.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:34.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:34.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:34.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:34.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:35.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:35.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:35.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:35.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:36.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:36.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:36.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:36.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:37.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:37.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:37.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:37.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:38.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:38.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:38.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:38.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:39.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:39.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:39.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:39.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:40.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:40.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:40.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:40.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:41.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:41.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:41.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:41.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:42.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:42.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:42.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:42.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:43.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:43.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:43.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:43.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:44.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:44.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:44.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:44.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:45.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:45.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:45.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:45.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:46.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:46.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:46.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:46.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:47.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:47.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:47.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:47.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:48.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:48.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:48.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:48.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:49.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:49.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:49.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:49.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:50.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:50.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:50.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:50.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:51.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:51.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:51.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:51.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:52.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:52.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:52.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:52.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:53.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:53.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:53.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:53.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:54.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:54.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:54.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:54.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:55.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:55.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:55.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:55.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:56.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:56.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:56.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:56.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:57.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:57.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:57.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:57.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:58.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:58.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:58.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:58.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:59.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:28:59.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:28:59.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:28:59.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:00.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:00.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:00.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:00.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:01.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:01.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:01.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:01.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:02.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:02.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:02.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:02.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:03.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:03.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:03.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:03.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:04.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:04.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:04.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:04.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:05.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:05.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:05.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:05.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:06.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:06.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:06.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:06.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:07.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:07.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:07.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:07.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:08.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:08.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:08.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:08.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:09.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:09.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:09.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:09.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:10.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:10.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:10.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:10.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:11.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:11.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:11.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:11.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:12.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:12.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:12.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:12.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:13.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:13.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:13.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:13.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:14.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:14.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:14.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:14.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:15.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:15.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:15.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:15.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:16.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:16.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:16.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:16.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:17.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:17.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:17.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:17.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:18.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:18.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:18.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:18.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:19.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:19.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:19.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:19.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:20.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:20.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:20.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:20.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:21.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:21.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:21.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:21.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:22.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:22.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:22.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:22.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:23.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:23.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:23.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:23.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:24.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:24.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:24.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:24.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:25.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:25.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:25.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:25.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:26.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:26.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:26.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:26.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:27.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:27.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:27.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:27.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:28.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:28.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:28.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:28.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:29.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:29.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:29.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:29.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:30.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:30.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:30.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:30.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:31.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:31.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:31.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:31.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:32.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:32.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:32.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:32.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:33.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:33.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:33.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:34.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:34.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:34.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:34.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:35.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:35.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:35.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:35.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:36.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:36.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:36.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:36.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:37.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:37.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:37.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:37.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:38.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:38.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:38.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:38.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:39.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:39.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:39.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:39.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:40.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:40.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:40.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:40.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:41.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:41.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:41.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:41.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:42.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:42.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:42.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:42.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:43.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:43.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:43.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:43.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:44.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:44.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:44.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:44.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:45.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:45.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:45.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:45.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:46.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:46.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:46.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:46.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:46.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:46.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:47.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:47.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:47.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:47.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:48.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:48.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:49.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:48.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:49.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:49.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:50.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:50.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:50.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:50.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:51.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:51.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:51.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:51.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:52.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:52.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:52.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:52.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:53.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:53.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:53.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:53.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:54.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:54.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:54.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:54.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:55.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:55.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:55.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:55.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:56.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:56.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:56.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:56.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:57.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:57.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:57.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:57.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:58.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:58.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:58.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:58.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:59.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:29:59.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:29:59.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:29:59.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:00.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:00.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:00.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:00.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:01.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:01.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:01.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:01.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:02.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:02.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:02.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:02.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:03.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:03.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:03.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:03.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:04.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:04.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:04.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:04.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:05.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:05.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:05.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:05.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:06.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:06.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:06.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:06.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:07.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:07.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:07.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:07.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:08.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:08.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:08.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:08.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:09.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:09.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:09.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:09.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:10.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:09.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:10.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:10.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:10.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:10.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:11.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:11.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:11.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:11.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:12.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:12.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:13.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:12.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:13.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:13.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:14.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:14.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:14.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:14.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:15.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:15.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:15.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:15.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:16.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:16.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:16.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:16.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:16.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:16.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:17.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:17.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:18.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:18.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:18.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:18.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:19.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:19.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:19.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:19.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:20.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:20.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:20.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:20.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:21.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:21.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:21.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:21.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:22.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:22.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:22.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:22.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:23.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:23.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:23.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:23.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:24.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:24.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:24.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:24.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:25.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:25.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:25.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:25.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:26.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:26.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:26.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:26.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:27.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:27.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:27.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:27.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:28.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:28.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:28.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:28.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:29.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:29.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:29.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:29.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:30.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:30.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:30.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:30.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:31.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:31.102+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:31.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:31.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:32.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:32.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:32.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:32.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:33.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:33.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:33.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:33.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:34.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:34.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:34.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:34.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:35.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:35.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:35.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:35.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:36.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:36.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:36.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:36.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:37.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:37.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:37.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:37.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:38.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:38.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:38.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:38.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:39.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:39.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:39.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:39.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:40.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:40.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:40.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:40.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:41.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:41.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:41.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:41.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:42.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:42.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:42.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:42.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:43.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:43.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:43.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:43.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:44.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:44.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:44.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:44.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:45.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:45.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:45.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:45.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:46.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:46.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:46.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:46.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:47.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:47.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:47.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:47.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:48.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:48.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:48.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:48.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:49.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:49.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:49.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:49.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:50.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:50.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:50.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:50.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:51.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:51.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:51.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:51.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:52.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:52.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:52.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:52.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:53.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:53.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:53.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:53.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:54.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:54.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:54.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:54.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:55.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:55.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:55.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:55.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:56.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:56.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:56.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:56.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:57.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:56.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:57.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:57.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:57.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:57.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:58.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:58.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:59.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:30:59.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:30:59.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:30:59.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:00.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:00.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:00.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:00.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:01.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:01.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:01.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:01.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:01.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:01.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:02.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:02.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:02.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:02.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:03.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:03.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:03.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:03.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:04.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:04.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:05.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:05.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:05.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:05.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:05.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:05.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:06.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:06.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:06.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:06.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:07.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:07.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:07.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:07.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:08.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:08.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:08.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:08.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:09.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:09.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:10.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:09.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:10.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:10.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:10.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:10.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:11.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:11.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:12.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:12.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:12.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:12.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:13.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:13.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:13.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:13.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:14.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:13.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:14.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:14.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:15.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:15.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:15.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:15.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:16.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:16.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:16.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:16.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:17.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:17.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:17.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:17.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:17.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:17.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:18.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:18.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:18.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:18.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:19.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:19.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:19.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:19.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:20.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:20.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:20.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:20.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:21.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:21.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:22.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:22.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:22.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:22.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:23.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:22.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:23.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:23.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:23.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:23.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:24.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:24.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:24.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:24.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:25.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:25.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:25.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:25.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:26.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:26.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:26.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:26.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:27.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:27.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:27.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:27.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:28.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:28.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:28.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:28.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:29.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:29.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:30.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:30.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:30.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:30.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:31.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:31.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:31.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:31.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:32.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:32.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:32.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:32.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:33.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:33.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:33.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:33.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:34.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:34.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:34.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:34.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:35.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:35.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:35.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:35.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:36.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:36.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:36.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:36.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:37.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:37.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:37.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:37.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:38.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:38.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:38.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:38.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:39.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:39.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:39.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:39.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:40.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:40.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:40.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:40.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:40.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:40.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:41.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:41.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:42.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:42.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:42.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:42.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:43.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:43.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:43.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:43.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:44.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:44.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:44.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:44.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:45.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:45.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:45.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:45.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:46.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:46.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:46.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:46.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:46.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:46.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:47.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:47.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:47.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:47.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:48.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:48.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:48.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:48.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:49.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:49.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:49.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:49.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:50.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:50.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:50.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:50.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:51.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:51.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:51.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:51.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:52.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:52.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:52.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:52.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:53.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:53.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:53.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:53.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:54.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:54.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:54.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:54.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:55.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:55.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:55.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:55.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:56.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:56.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:56.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:56.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:57.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:57.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:57.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:57.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:58.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:58.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:58.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:58.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:59.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:31:59.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:31:59.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:31:59.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:00.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:00.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:00.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:00.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:01.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:01.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:01.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:01.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:02.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:02.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:02.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:02.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:03.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:03.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:03.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:03.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:04.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:04.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:04.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:04.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:05.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:05.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:05.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:05.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:06.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:06.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:06.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:06.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:07.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:07.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:07.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:07.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:08.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:08.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:08.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:08.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:09.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:09.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:09.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:09.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:10.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:10.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:10.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:10.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:11.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:11.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:11.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:11.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:12.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:12.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:12.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:12.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:13.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:13.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:13.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:13.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:14.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:14.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:14.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:14.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:15.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:15.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:15.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:15.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:16.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:16.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:16.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:16.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:17.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:17.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:17.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:17.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:18.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:18.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:18.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:18.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:19.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:19.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:19.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:19.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:20.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:20.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:20.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:20.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:21.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:21.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:21.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:21.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:22.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:22.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:22.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:22.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:23.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:23.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:23.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:23.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:24.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:24.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:24.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:24.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:25.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:25.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:26.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:26.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:26.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:26.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:27.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:27.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:27.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:27.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:28.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:28.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:28.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:28.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:29.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:29.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:29.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:29.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:30.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:30.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:30.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:30.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:31.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:31.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:31.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:31.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:32.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:32.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:32.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:32.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:33.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:33.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:33.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:33.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:34.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:34.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:34.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:34.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:35.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:35.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:35.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:35.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:36.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:36.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:36.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:36.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:37.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:37.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:37.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:37.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:38.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:38.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:38.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:38.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:39.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:39.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:39.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:39.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:40.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:40.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:40.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:40.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:41.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:41.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:41.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:41.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:42.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:42.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:42.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:42.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:43.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:43.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:43.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:43.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:44.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:44.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:44.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:44.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:45.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:45.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:45.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:45.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:46.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:46.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:46.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:46.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:47.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:47.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:47.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:47.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:48.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:48.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:48.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:48.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:49.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:49.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:49.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:49.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:50.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:50.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:50.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:50.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:51.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:51.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:51.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:51.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:52.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:52.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:52.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:52.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:53.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:53.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:53.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:53.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:54.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:54.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:54.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:54.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:55.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:55.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:55.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:55.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:56.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:56.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:56.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:56.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:57.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:57.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:57.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:57.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:58.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:58.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:58.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:58.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:59.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:32:59.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:32:59.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:32:59.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:00.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:00.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:00.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:00.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:01.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:01.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:01.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:01.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:02.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:02.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:02.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:02.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:03.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:03.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:03.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:03.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:04.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:04.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:04.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:04.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:05.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:05.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:05.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:05.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:06.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:06.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:06.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:06.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:07.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:07.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:07.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:07.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:08.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:08.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:08.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:08.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:09.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:09.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:09.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:09.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:10.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:10.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:10.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:10.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:11.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:11.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:11.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:11.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:12.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:12.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:12.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:12.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:13.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:13.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:13.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:13.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:14.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:14.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:14.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:14.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:15.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:15.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:15.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:15.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:16.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:16.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:16.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:16.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:17.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:17.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:17.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:17.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:18.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:18.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:18.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:18.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:19.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:19.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:19.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:19.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:20.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:20.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:20.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:20.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:21.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:21.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:21.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:21.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:22.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:22.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:22.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:22.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:23.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:23.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:23.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:23.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:24.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:24.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:24.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:24.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:25.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:25.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:25.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:25.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:26.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:26.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:26.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:26.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:27.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:27.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:27.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:27.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:28.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:28.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:28.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:28.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:29.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:29.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:29.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:29.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:30.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:30.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:30.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:30.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:31.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:31.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:31.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:31.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:32.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:32.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:32.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:32.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:33.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:33.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:33.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:33.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:34.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:34.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:34.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:34.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:35.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:35.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:35.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:35.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:36.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:36.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:36.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:36.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:37.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:37.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:37.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:37.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:38.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:38.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:38.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:38.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:39.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:39.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:39.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:39.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:40.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:40.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:40.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:40.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:41.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:41.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:41.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:41.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:42.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:42.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:42.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:42.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:43.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:43.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:43.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:43.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:44.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:44.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:44.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:44.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:45.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:45.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:45.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:45.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:46.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:46.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:46.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:46.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:47.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:47.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:47.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:47.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:48.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:48.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:48.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:48.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:49.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:49.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:49.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:49.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:50.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:50.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:50.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:50.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:51.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:51.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:51.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:51.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:52.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:52.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:52.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:52.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:53.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:53.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:53.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:53.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:54.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:54.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:55.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:55.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:55.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:55.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:55.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:55.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:56.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:56.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:56.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:56.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:57.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:57.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:57.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:57.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:58.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:58.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:58.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:58.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:59.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:33:59.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:33:59.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:33:59.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:00.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:00.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:00.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:00.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:01.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:01.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:01.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:01.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:02.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:02.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:02.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:02.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:03.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:03.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:03.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:03.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:04.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:04.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:04.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:04.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:05.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:05.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:05.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:05.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:06.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:06.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:06.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:06.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:07.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:07.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:07.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:07.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:08.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:08.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:08.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:08.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:09.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:09.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:10.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:09.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:10.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:10.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:11.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:11.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:11.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:11.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:11.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:11.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:12.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:12.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:13.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:13.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:13.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:13.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:13.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:13.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:14.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:14.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:14.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:14.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:15.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:15.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:15.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:15.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:16.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:16.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:16.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:16.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:17.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:17.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:17.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:17.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:18.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:18.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:18.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:18.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:19.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:19.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:19.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:19.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:20.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:20.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:20.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:20.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:21.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:21.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:21.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:21.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:22.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:22.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:22.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:22.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:23.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:23.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:23.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:23.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:24.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:24.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:24.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:24.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:25.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:25.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:25.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:25.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:26.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:26.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:26.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:26.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:27.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:27.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:27.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:27.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:28.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:28.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:28.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:28.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:29.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:29.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:30.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:30.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:30.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:30.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:31.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:31.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:31.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:31.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:32.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:32.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:32.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:32.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:33.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:33.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:33.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:33.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:34.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:34.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:34.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:34.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:35.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:35.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:35.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:35.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:36.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:36.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:36.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:36.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:37.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:37.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:38.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:37.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:38.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:38.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:38.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:38.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:39.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:39.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:39.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:39.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:40.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:40.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:40.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:40.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:41.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:41.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:41.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:41.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:42.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:42.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:42.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:42.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:43.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:43.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:43.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:43.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:44.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:44.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:44.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:44.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:45.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:45.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:45.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:45.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:46.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:46.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:46.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:46.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:47.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:47.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:47.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:47.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:48.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:47.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:48.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:48.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:48.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:48.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:49.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:49.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:50.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:49.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:50.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:50.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:51.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:51.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:51.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:51.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:52.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:52.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:52.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:52.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:53.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:53.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:53.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:53.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:54.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:54.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:54.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:54.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:55.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:55.036+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:55.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:55.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:56.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:56.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:56.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:56.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:57.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:57.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:57.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:57.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:58.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:58.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:58.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:58.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:59.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:34:59.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:34:59.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:34:59.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:00.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:00.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:00.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:00.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:01.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:01.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:01.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:01.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:02.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:02.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:02.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:02.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:03.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:03.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:03.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:03.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:04.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:04.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:04.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:04.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:05.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:05.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:05.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:05.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:06.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:06.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:06.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:06.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:07.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:07.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:07.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:07.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:08.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:08.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:08.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:08.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:09.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:09.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:09.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:09.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:10.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:10.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:10.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:10.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:11.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:11.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:11.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:11.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:12.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:12.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:12.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:12.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:13.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:13.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:13.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:13.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:14.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:14.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:14.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:14.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:15.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:15.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:15.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:15.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:16.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:16.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:16.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:16.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:17.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:17.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:17.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:17.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:18.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:18.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:19.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:19.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:19.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:19.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:20.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:20.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:20.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:20.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:21.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:21.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:21.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:21.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:22.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:22.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:22.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:22.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:23.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:23.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:23.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:23.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:24.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:24.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:24.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:24.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:25.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:25.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:25.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:25.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:26.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:26.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:26.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:26.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:27.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:27.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:27.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:27.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:28.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:28.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:28.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:28.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:29.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:29.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:29.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:29.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:30.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:30.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:30.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:30.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:31.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:31.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:31.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:31.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:32.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:32.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:32.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:32.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:33.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:33.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:33.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:33.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:34.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:34.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:34.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:34.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:35.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:35.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:35.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:35.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:36.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:36.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:36.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:36.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:37.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:37.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:37.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:37.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:38.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:38.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:38.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:38.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:39.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:39.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:39.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:39.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:40.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:40.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:40.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:40.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:41.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:41.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:41.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:41.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:42.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:42.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:42.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:42.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:43.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:43.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:43.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:43.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:44.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:44.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:44.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:44.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:45.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:45.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:45.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:45.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:46.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:46.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:46.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:46.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:47.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:47.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:47.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:47.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:48.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:48.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:48.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:48.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:49.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:49.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:49.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:49.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:50.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:50.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:50.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:50.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:51.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:51.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:51.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:51.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:52.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:52.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:52.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:52.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:53.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:53.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:53.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:53.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:54.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:54.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:54.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:54.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:55.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:55.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:55.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:55.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:56.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:56.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:56.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:56.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:57.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:57.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:57.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:57.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:58.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:58.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:58.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:58.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:59.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:35:59.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:35:59.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:35:59.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:00.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:00.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:00.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:00.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:01.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:01.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:01.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:01.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:02.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:02.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:02.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:02.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:03.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:03.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:03.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:03.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:04.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:04.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:04.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:04.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:05.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:05.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:05.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:05.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:06.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:06.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:06.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:06.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:07.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:07.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:07.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:07.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:08.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:08.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:08.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:08.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:09.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:09.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:09.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:09.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:10.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:10.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:10.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:10.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:11.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:11.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:11.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:11.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:12.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:12.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:12.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:12.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:13.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:13.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:13.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:13.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:14.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:14.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:14.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:14.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:15.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:15.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:15.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:15.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:16.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:16.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:16.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:16.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:17.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:17.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:17.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:17.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:18.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:18.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:18.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:18.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:19.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:19.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:19.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:19.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:20.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:20.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:20.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:20.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:21.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:21.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:21.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:21.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:22.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:22.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:22.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:22.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:23.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:23.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:23.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:23.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:24.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:24.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:24.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:24.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:25.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:25.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:25.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:25.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:26.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:26.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:26.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:26.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:26.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:26.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:27.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:27.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:27.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:27.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:28.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:28.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:28.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:28.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:29.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:29.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:29.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:29.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:30.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:30.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:30.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:30.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:31.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:31.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:31.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:31.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:32.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:32.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:33.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:32.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:33.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:33.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:34.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:34.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:34.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:34.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:35.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:35.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:35.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:35.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:35.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:35.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:36.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:36.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:36.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:36.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:37.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:37.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:37.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:37.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:38.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:38.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:38.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:38.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:39.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:39.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:39.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:39.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:40.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:40.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:40.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:40.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:41.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:41.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:41.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:41.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:42.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:42.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:43.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:43.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:43.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:43.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:43.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:43.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:44.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:44.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:44.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:44.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:45.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:45.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:46.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:46.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:46.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:46.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:47.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:47.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:47.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:47.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:48.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:48.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:48.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:48.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:49.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:49.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:49.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:49.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:50.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:50.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:50.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:50.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:51.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:51.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:51.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:51.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:52.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:52.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:52.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:52.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:53.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:53.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:53.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:53.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:54.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:54.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:54.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:54.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:55.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:55.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:55.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:55.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:56.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:56.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:56.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:56.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:57.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:57.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:57.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:57.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:58.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:58.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:58.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:58.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:59.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:36:59.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:36:59.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:36:59.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:00.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:00.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:00.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:00.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:01.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:01.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:01.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:01.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:02.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:02.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:02.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:02.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:03.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:03.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:03.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:03.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:04.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:04.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:04.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:04.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:05.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:05.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:05.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:05.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:06.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:06.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:06.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:06.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:07.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:07.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:07.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:07.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:08.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:08.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:08.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:08.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:09.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:09.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:09.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:09.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:10.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:10.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:10.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:10.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:11.106 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:11.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:11.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:11.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:12.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:12.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:12.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:12.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:13.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:13.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:13.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:13.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:14.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:14.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:14.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:14.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:15.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:15.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:15.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:15.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:16.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:16.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:16.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:16.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:17.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:17.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:17.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:17.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:18.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:18.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:18.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:18.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:19.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:19.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:19.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:19.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:20.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:20.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:20.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:20.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:21.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:21.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:21.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:21.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:22.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:22.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:22.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:22.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:23.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:23.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:23.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:23.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:24.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:24.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:24.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:24.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:25.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:25.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:25.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:25.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:26.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:26.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:26.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:26.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:27.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:27.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:27.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:27.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:28.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:28.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:28.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:28.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:29.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:29.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:29.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:29.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:30.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:30.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:30.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:30.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:31.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:31.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:31.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:31.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:32.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:32.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:32.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:32.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:33.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:33.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:33.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:33.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:34.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:34.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:34.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:34.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:35.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:35.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:35.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:35.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:36.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:36.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:36.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:36.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:37.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:37.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:37.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:37.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:38.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:38.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:38.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:38.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:39.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:39.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:39.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:39.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:40.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:40.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:40.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:40.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:41.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:41.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:41.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:41.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:42.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:42.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:42.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:42.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:43.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:43.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:43.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:43.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:44.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:44.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:44.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:44.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:45.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:45.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:45.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:45.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:46.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:46.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:46.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:46.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:47.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:47.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:47.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:47.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:48.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:48.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:48.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:48.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:49.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:49.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:49.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:49.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:50.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:50.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:50.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:50.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:51.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:51.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:51.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:51.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:52.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:52.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:52.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:52.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:53.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:53.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:53.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:53.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:54.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:54.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:54.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:54.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:55.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:55.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:55.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:55.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:56.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:56.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:56.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:56.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:57.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:57.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:57.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:57.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:58.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:58.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:58.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:58.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:59.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:37:59.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:37:59.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:37:59.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:00.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:00.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:00.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:00.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:01.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:01.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:01.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:01.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:02.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:02.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:02.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:02.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:03.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:03.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:03.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:03.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:04.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:04.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:04.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:04.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:05.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:05.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:05.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:05.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:06.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:06.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:06.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:06.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:07.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:07.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:07.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:07.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:08.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:08.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:08.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:08.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:09.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:09.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:09.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:09.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:10.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:10.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:10.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:10.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:11.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:11.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:11.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:11.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:12.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:12.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:12.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:12.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:13.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:13.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:13.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:13.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:14.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:14.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:14.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:14.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:15.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:15.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:15.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:15.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:16.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:16.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:16.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:16.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:17.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:17.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:17.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:17.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:18.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:18.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:18.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:18.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:19.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:19.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:19.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:19.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:20.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:20.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:20.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:20.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:21.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:21.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:21.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:21.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:22.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:22.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:22.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:22.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:23.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:23.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:23.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:23.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:24.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:24.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:24.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:24.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:25.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:25.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:25.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:25.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:26.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:26.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:26.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:26.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:27.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:27.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:27.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:27.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:28.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:28.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:28.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:28.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:29.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:29.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:29.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:29.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:30.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:30.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:30.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:30.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:31.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:31.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:31.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:31.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:32.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:32.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:32.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:32.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:33.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:33.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:33.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:33.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:34.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:34.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:34.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:34.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:35.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:35.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:35.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:35.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:36.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:36.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:36.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:36.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:37.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:37.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:37.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:37.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:38.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:38.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:38.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:38.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:39.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:39.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:39.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:39.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:40.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:40.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:40.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:40.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:41.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:41.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:41.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:41.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:42.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:42.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:42.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:42.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:43.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:43.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:43.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:43.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:44.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:44.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:44.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:44.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:45.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:45.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:45.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:45.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:46.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:46.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:46.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:46.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:47.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:47.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:47.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:47.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:48.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:48.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:48.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:48.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:49.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:49.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:49.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:49.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:50.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:50.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:50.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:50.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:51.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:51.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:51.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:51.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:52.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:52.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:52.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:52.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:53.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:53.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:53.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:53.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:54.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:54.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:54.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:54.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:55.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:55.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:55.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:55.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:56.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:56.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:56.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:56.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:57.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:57.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:57.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:57.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:58.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:58.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:58.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:58.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:59.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:38:59.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:38:59.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:38:59.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:00.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:00.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:00.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:00.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:01.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:01.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:01.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:01.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:02.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:02.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:02.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:02.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:03.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:03.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:03.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:03.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:04.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:04.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:04.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:04.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:05.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:05.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:05.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:05.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:06.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:06.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:06.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:06.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:07.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:07.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:07.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:07.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:08.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:08.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:08.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:08.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:09.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:09.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:10.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:10.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:10.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:10.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:11.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:11.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:11.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:11.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:12.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:12.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:12.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:12.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:13.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:13.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:13.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:13.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:14.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:14.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:14.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:14.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:15.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:15.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:15.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:15.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:16.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:16.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:16.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:16.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:17.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:17.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:17.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:17.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:18.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:18.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:18.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:18.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:18.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:18.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:19.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:19.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:19.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:19.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:20.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:20.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:21.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:21.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:21.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:21.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:22.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:22.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:22.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:22.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:23.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:23.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:23.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:23.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:24.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:24.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:24.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:24.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:25.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:25.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:25.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:25.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:26.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:26.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:26.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:27.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:27.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:27.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:27.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:28.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:28.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:28.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:28.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:29.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:29.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:29.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:29.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:30.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:30.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:30.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:30.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:31.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:31.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:31.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:31.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:32.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:32.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:32.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:32.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:33.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:33.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:34.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:33.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:34.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:34.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:34.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:34.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:35.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:35.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:36.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:36.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:36.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:36.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:37.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:37.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:37.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:37.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:38.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:38.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:38.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:38.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:39.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:39.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:39.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:39.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:40.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:40.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:40.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:40.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:41.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:41.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:41.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:41.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:42.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:42.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:42.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:42.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:43.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:43.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:43.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:43.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:44.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:44.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:44.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:44.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:45.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:45.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:45.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:45.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:46.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:46.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:46.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:46.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:47.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:47.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:47.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:47.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:48.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:48.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:48.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:48.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:49.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:49.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:49.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:49.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:50.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:50.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:50.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:50.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:51.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:51.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:51.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:51.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:52.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:52.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:52.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:52.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:53.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:53.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:53.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:53.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:54.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:54.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:54.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:54.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:55.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:55.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:55.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:55.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:55.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:55.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:56.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:56.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:57.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:57.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:57.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:57.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:58.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:58.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:58.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:58.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:59.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:39:59.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:39:59.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:39:59.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:00.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:00.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:00.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:00.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:01.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:00.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:01.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:01.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:02.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:02.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:02.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:02.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:03.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:03.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:03.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:03.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:04.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:04.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:04.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:04.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:04.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:04.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:05.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:05.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:06.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:06.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:06.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:06.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:07.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:07.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:07.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:07.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:07.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:07.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:08.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:08.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:09.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:09.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:09.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:09.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:10.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:10.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:10.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:10.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:11.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:11.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:11.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:11.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:12.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:12.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:12.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:12.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:12.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:12.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:13.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:13.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:13.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:13.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:14.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:14.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:14.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:14.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:15.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:15.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:15.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:15.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:16.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:16.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:16.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:16.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:17.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:17.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:17.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:17.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:18.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:18.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:18.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:18.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:19.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:19.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:19.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:19.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:20.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:20.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:20.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:20.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:21.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:21.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:21.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:21.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:22.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:22.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:23.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:23.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:23.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:23.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:24.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:24.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:24.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:24.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:24.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:24.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:25.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:25.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:26.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:26.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:26.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:26.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:26.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:26.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:27.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:27.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:27.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:27.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:28.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:28.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:28.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:28.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:29.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:29.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:29.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:29.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:30.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:30.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:30.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:30.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:31.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:31.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:31.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:31.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:32.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:32.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:32.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:32.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:33.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:33.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:33.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:33.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:34.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:34.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:35.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:35.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:35.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:35.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:36.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:35.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:36.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:36.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:36.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:36.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:37.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:37.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:37.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:37.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:38.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:38.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:38.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:38.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:39.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:39.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:40.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:40.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:40.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:40.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:41.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:41.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:41.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:41.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:41.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:41.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:42.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:42.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:42.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:42.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:43.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:43.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:44.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:44.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:44.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:44.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:45.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:45.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:45.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:45.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:46.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:46.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:46.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:46.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:47.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:47.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:47.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:47.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:48.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:48.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:48.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:48.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:49.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:49.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:49.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:49.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:50.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:50.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:50.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:50.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:51.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:51.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:51.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:51.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:52.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:52.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:52.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:52.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:53.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:53.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:53.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:53.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:54.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:54.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:54.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:54.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:55.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:55.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:55.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:55.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:56.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:56.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:56.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:56.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:57.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:57.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:57.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:57.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:58.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:58.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:58.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:58.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:59.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:40:59.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:40:59.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:40:59.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:00.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:00.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:00.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:00.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:01.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:01.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:01.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:01.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:02.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:02.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:02.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:02.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:03.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:03.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:03.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:03.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:04.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:04.240+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:04.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:04.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:05.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:05.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:05.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:05.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:06.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:06.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:06.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:06.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:07.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:07.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:07.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:07.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:08.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:08.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:08.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:08.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:09.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:09.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:09.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:09.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:10.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:10.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:10.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:10.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:11.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:11.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:11.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:11.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:12.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:12.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:12.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:12.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:13.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:13.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:13.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:13.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:14.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:14.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:14.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:14.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:15.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:15.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:15.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:15.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:16.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:16.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:16.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:16.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:17.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:17.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:17.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:17.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:18.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:18.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:18.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:18.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:19.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:19.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:19.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:19.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:20.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:20.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:20.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:20.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:21.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:21.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:21.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:21.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:22.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:22.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:22.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:22.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:23.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:23.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:23.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:23.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:24.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:24.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:24.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:24.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:25.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:25.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:25.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:25.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:26.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:26.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:26.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:26.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:27.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:27.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:27.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:27.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:28.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:28.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:28.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:28.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:29.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:29.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:29.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:30.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:30.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:30.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:30.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:31.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:31.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:31.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:31.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:32.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:32.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:32.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:32.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:33.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:33.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:33.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:33.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:34.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:34.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:34.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:34.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:35.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:35.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:35.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:35.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:36.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:36.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:36.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:36.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:37.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:37.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:37.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:37.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:38.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:38.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:38.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:38.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:39.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:39.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:39.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:39.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:40.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:40.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:40.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:40.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:41.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:41.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:41.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:41.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:42.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:42.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:42.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:42.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:42.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:42.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:43.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:43.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:44.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:43.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:44.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:44.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:45.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:44.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:45.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:45.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:46.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:46.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:46.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:46.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:47.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:47.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:47.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:47.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:48.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:48.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:48.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:48.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:49.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:49.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:49.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:49.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:50.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:50.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:50.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:50.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:51.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:51.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:51.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:51.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:52.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:52.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:52.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:52.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:53.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:53.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:53.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:53.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:54.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:54.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:54.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:54.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:55.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:55.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:55.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:55.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:56.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:56.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:56.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:56.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:57.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:57.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:57.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:57.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:58.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:58.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:58.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:58.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:59.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:59.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:41:59.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:41:59.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:00.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:41:59.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:00.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:00.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:01.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:01.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:01.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:01.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:02.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:02.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:02.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:02.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:03.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:03.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:03.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:03.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:04.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:04.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:04.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:04.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:05.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:05.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:05.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:05.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:06.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:06.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:06.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:06.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:07.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:07.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:07.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:07.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:08.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:08.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:08.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:08.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:09.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:09.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:09.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:09.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:10.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:10.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:10.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:10.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:11.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:11.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:11.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:11.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:12.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:12.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:12.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:12.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:13.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:13.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:13.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:13.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:14.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:14.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:14.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:14.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:15.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:15.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:15.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:15.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:16.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:16.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:16.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:16.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:17.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:17.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:17.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:17.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:18.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:18.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:18.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:18.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:19.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:19.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:19.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:19.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:20.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:20.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:20.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:20.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:21.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:21.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:21.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:21.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:22.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:22.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:22.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:22.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:23.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:23.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:23.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:23.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:24.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:24.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:24.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:24.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:25.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:25.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:25.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:25.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:26.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:26.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:26.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:26.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:27.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:27.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:27.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:27.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:28.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:28.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:28.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:28.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:29.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:29.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:29.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:29.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:30.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:30.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:30.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:30.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:31.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:31.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:31.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:31.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:32.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:32.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:32.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:32.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:33.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:33.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:33.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:33.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:34.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:34.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:34.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:34.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:35.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:35.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:35.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:35.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:36.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:36.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:36.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:36.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:37.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:37.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:37.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:37.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:38.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:38.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:38.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:38.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:39.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:39.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:39.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:39.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:40.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:40.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:40.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:40.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:41.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:41.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:41.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:41.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:42.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:42.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:42.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:42.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:43.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:43.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:43.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:43.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:44.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:44.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:44.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:44.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:45.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:45.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:45.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:45.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:46.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:46.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:46.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:46.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:47.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:47.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:47.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:47.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:48.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:48.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:48.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:48.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:49.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:49.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:49.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:49.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:50.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:50.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:50.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:50.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:51.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:51.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:51.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:51.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:52.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:52.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:52.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:52.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:53.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:53.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:53.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:53.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:54.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:54.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:54.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:54.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:55.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:55.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:55.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:55.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:56.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:56.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:56.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:56.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:57.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:57.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:57.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:57.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:58.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:58.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:58.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:58.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:59.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:42:59.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:42:59.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:42:59.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:00.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:00.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:00.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:00.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:01.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:01.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:01.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:01.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:02.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:02.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:02.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:02.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:03.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:03.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:03.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:03.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:04.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:04.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:04.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:04.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:05.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:05.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:05.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:05.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:06.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:06.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:06.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:06.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:07.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:07.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:07.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:07.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:08.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:08.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:08.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:08.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:09.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:09.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:09.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:09.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:10.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:10.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:10.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:10.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:11.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:11.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:11.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:11.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:12.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:12.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:12.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:12.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:13.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:13.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:13.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:13.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:14.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:14.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:14.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:14.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:15.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:15.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:15.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:15.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:16.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:16.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:16.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:16.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:17.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:17.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:17.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:17.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:18.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:18.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:18.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:18.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:19.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:19.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:19.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:19.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:20.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:20.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:20.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:20.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:21.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:21.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:21.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:21.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:22.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:22.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:22.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:22.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:23.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:23.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:23.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:23.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:24.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:24.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:24.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:24.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:25.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:25.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:25.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:25.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:26.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:26.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:26.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:26.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:27.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:27.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:27.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:27.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:28.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:28.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:28.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:28.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:29.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:29.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:29.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:29.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:30.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:30.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:30.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:30.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:31.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:31.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:31.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:31.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:32.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:32.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:32.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:32.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:33.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:33.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:33.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:33.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:34.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:34.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:34.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:34.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:35.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:35.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:35.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:35.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:36.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:36.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:36.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:36.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:37.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:37.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:37.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:37.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:38.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:38.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:38.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:38.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:39.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:39.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:39.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:39.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:40.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:40.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:40.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:40.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:41.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:41.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:41.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:41.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:42.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:42.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:42.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:42.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:43.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:43.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:43.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:43.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:44.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:44.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:44.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:44.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:45.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:45.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:45.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:45.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:46.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:46.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:46.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:46.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:47.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:47.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:47.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:47.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:48.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:48.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:48.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:48.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:49.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:49.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:49.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:49.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:50.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:50.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:50.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:50.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:51.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:51.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:51.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:51.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:52.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:52.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:52.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:52.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:53.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:53.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:53.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:53.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:54.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:54.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:54.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:54.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:55.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:55.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:55.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:55.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:56.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:56.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:56.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:56.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:57.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:57.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:57.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:57.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:58.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:58.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:58.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:58.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:59.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:43:59.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:43:59.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:43:59.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:00.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:00.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:00.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:00.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:01.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:01.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:01.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:01.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:02.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:02.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:02.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:02.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:03.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:03.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:03.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:03.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:04.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:04.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:04.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:04.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:05.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:05.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:05.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:05.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:06.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:06.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:06.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:06.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:07.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:07.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:07.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:07.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:08.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:08.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:08.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:08.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:09.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:09.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:09.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:09.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:10.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:10.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:10.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:10.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:11.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:11.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:11.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:11.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:12.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:12.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:12.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:12.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:13.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:13.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:13.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:13.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:14.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:14.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:14.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:14.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:15.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:15.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:15.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:15.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:16.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:16.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:16.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:16.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:17.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:17.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:17.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:17.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:18.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:18.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:18.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:18.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:19.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:19.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:19.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:19.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:20.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:20.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:20.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:20.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:21.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:21.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:21.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:21.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:22.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:22.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:22.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:22.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:23.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:23.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:23.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:23.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:24.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:24.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:24.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:24.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:25.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:25.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:25.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:25.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:26.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:26.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:26.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:26.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:27.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:27.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:27.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:27.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:28.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:28.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:28.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:28.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:29.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:29.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:29.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:29.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:30.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:30.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:30.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:30.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:31.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:31.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:31.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:31.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:32.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:32.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:32.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:32.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:33.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:33.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:33.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:33.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:34.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:34.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:34.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:34.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:35.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:35.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:35.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:35.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:36.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:36.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:36.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:36.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:37.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:37.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:37.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:37.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:38.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:38.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:38.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:38.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:39.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:39.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:39.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:39.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:40.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:40.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:40.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:40.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:41.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:41.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:41.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:41.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:42.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:42.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:42.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:42.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:43.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:43.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:43.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:43.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:44.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:44.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:44.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:44.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:45.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:45.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:45.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:45.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:46.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:46.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:46.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:46.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:47.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:47.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:47.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:47.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:48.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:48.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:48.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:48.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:49.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:49.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:49.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:49.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:50.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:50.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:50.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:50.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:51.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:51.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:51.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:51.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:52.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:52.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:52.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:52.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:53.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:53.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:53.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:53.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:54.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:54.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:54.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:54.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:55.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:55.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:55.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:55.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:56.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:56.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:56.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:56.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:57.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:57.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:57.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:57.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:58.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:58.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:58.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:58.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:59.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:44:59.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:44:59.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:44:59.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:00.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:00.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:00.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:00.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:01.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:01.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:01.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:01.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:02.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:02.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:02.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:02.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:03.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:03.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:03.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:03.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:04.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:04.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:04.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:04.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:05.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:05.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:05.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:05.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:06.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:06.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:06.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:06.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:07.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:07.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:07.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:07.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:08.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:08.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:08.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:08.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:09.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:09.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:09.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:09.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:10.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:10.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:10.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:10.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:11.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:11.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:11.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:11.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:12.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:12.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:12.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:12.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:13.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:13.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:13.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:13.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:14.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:14.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:14.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:14.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:15.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:15.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:15.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:15.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:16.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:16.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:16.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:16.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:17.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:17.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:17.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:17.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:18.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:18.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:18.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:18.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:19.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:19.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:19.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:19.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:20.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:20.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:20.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:20.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:21.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:21.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:21.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:21.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:22.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:22.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:22.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:22.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:23.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:23.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:23.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:23.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:24.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:24.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:24.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:24.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:25.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:25.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:25.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:25.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:26.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:26.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:26.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:26.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:27.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:27.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:27.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:27.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:28.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:28.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:28.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:28.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:29.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:29.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:29.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:29.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:30.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:30.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:30.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:30.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:31.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:31.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:31.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:31.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:32.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:32.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:32.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:32.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:33.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:33.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:33.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:33.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:34.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:34.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:34.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:34.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:35.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:35.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:35.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:35.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:36.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:36.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:36.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:36.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:37.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:37.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:37.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:37.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:38.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:38.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:38.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:38.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:39.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:39.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:39.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:39.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:40.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:40.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:40.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:40.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:41.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:41.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:41.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:41.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:42.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:42.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:42.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:42.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:43.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:43.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:43.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:43.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:44.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:44.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:44.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:44.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:45.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:45.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:45.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:45.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:46.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:46.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:46.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:46.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:47.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:47.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:47.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:47.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:48.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:48.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:48.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:48.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:49.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:49.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:49.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:49.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:50.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:50.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:50.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:50.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:51.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:51.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:51.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:51.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:52.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:52.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:52.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:52.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:53.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:53.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:53.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:53.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:54.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:54.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:54.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:54.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:55.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:55.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:55.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:55.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:56.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:56.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:57.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:57.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:57.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:57.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:58.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:58.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:58.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:58.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:59.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:45:59.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:45:59.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:45:59.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:00.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:00.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:00.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:00.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:01.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:01.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:01.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:01.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:02.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:02.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:02.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:02.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:03.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:03.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:03.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:03.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:04.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:04.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:04.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:04.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:05.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:05.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:05.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:05.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:06.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:05.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:06.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:06.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:07.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:07.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:07.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:07.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:08.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:08.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:08.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:08.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:09.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:09.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:09.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:09.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:10.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:10.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:10.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:10.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:11.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:11.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:11.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:11.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:12.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:12.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:12.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:12.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:13.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:13.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:13.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:13.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:14.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:14.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:14.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:14.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:15.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:15.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:15.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:15.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:15.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:15.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:16.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:16.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:16.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:16.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:17.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:17.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:17.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:17.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:18.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:18.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:18.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:18.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:19.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:19.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:19.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:19.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:20.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:20.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:20.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:20.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:21.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:21.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:21.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:21.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:22.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:22.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:22.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:22.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:23.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:23.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:24.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:23.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:24.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:24.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:25.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:24.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:25.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:25.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:26.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:26.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:26.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:26.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:27.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:27.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:27.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:27.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:28.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:28.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:28.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:28.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:28.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:28.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:29.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:29.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:30.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:30.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:30.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:30.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:31.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:31.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:31.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:31.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:32.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:32.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:32.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:32.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:33.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:33.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:33.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:33.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:33.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:33.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:34.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:34.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:34.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:34.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:35.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:35.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:35.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:35.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:36.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:36.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:36.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:36.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:37.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:37.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:37.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:37.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:38.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:38.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:38.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:38.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:39.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:39.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:39.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:39.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:40.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:40.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:40.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:40.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:41.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:41.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:41.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:41.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:42.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:42.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:43.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:43.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:43.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:43.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:44.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:44.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:44.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:44.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:45.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:45.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:45.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:45.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:46.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:46.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:46.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:46.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:47.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:47.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:47.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:47.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:48.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:48.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:48.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:48.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:49.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:49.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:49.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:49.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:50.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:50.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:50.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:50.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:51.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:51.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:51.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:51.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:52.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:52.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:52.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:52.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:53.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:53.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:53.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:53.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:54.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:54.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:54.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:54.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:55.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:55.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:55.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:55.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:56.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:56.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:56.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:56.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:57.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:57.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:57.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:57.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:58.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:58.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:58.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:58.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:59.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:46:59.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:46:59.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:46:59.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:00.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:00.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:00.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:00.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:01.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:01.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:01.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:01.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:02.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:02.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:02.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:02.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:03.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:03.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:03.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:03.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:04.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:04.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:04.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:04.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:05.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:05.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:05.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:05.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:06.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:06.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:06.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:06.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:07.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:07.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:07.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:07.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:08.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:08.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:08.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:08.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:09.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:09.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:09.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:09.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:10.079 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:10.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:10.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:10.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:11.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:11.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:11.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:11.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:12.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:12.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:12.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:12.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:13.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:13.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:13.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:13.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:14.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:14.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:14.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:14.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:15.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:15.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:15.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:15.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:15.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:15.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:16.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:16.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:16.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:16.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:17.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:17.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:18.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:17.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:18.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:18.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:19.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:19.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:19.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:19.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:20.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:20.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:20.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:20.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:21.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:21.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:21.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:21.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:22.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:22.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:22.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:22.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:23.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:23.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:23.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:23.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:24.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:24.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:24.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:24.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:25.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:25.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:25.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:25.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:26.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:26.031+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:26.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:26.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:27.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:26.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:27.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:27.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:28.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:28.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:28.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:28.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:29.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:29.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:29.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:29.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:30.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:30.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:30.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:30.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:31.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:31.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:31.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:31.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:32.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:32.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:32.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:32.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:33.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:33.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:33.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:33.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:34.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:34.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:34.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:34.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:35.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:35.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:35.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:35.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:36.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:36.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:36.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:36.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:37.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:37.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:37.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:37.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:38.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:38.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:38.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:38.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:39.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:39.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:39.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:39.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:40.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:40.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:40.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:40.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:41.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:41.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:41.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:41.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:42.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:42.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:42.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:42.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:43.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:43.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:43.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:43.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:44.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:44.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:44.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:44.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:45.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:45.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:45.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:45.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:46.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:46.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:46.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:46.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:47.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:47.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:47.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:47.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:48.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:48.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:48.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:48.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:49.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:49.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:49.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:49.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:50.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:50.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:50.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:50.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:51.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:51.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:51.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:51.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:52.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:52.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:52.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:53.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:53.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:53.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:53.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:54.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:54.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:54.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:54.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:55.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:55.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:55.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:55.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:56.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:56.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:56.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:56.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:57.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:57.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:57.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:57.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:58.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:58.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:58.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:58.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:59.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:47:59.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:47:59.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:47:59.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:00.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:00.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:00.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:00.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:01.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:01.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:01.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:01.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:02.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:02.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:02.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:02.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:03.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:03.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:03.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:03.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:04.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:04.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:04.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:04.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:05.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:05.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:05.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:05.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:06.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:06.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:06.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:06.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:07.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:07.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:07.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:07.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:08.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:08.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:08.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:08.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:09.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:09.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:09.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:09.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:10.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:10.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:10.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:10.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:11.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:11.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:11.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:11.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:12.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:12.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:12.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:12.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:13.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:13.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:13.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:13.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:14.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:14.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:14.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:14.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:15.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:15.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:15.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:15.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:16.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:16.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:16.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:16.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:17.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:17.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:17.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:17.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:18.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:18.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:18.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:18.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:19.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:19.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:19.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:19.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:20.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:20.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:20.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:20.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:21.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:21.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:21.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:21.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:22.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:22.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:22.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:22.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:23.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:23.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:23.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:23.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:24.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:24.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:24.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:24.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:25.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:25.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:25.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:25.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:26.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:26.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:26.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:26.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:27.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:27.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:27.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:27.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:28.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:28.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:28.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:28.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:29.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:29.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:29.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:29.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:30.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:30.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:30.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:30.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:31.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:31.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:31.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:31.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:32.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:32.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:32.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:32.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:33.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:33.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:33.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:33.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:34.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:34.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:34.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:34.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:35.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:35.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:35.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:35.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:36.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:36.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:36.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:36.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:37.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:37.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:37.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:37.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:38.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:38.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:38.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:38.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:39.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:39.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:39.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:39.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:40.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:40.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:40.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:40.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:41.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:41.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:41.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:41.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:42.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:42.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:42.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:42.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:43.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:43.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:43.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:43.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:44.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:44.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:44.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:44.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:45.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:45.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:45.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:45.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:46.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:46.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:46.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:46.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:47.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:47.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:47.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:47.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:48.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:48.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:48.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:48.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:49.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:49.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:49.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:49.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:50.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:50.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:50.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:50.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:51.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:51.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:51.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:51.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:52.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:52.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:52.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:52.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:53.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:53.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:53.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:53.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:54.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:54.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:54.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:54.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:55.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:55.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:55.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:55.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:56.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:56.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:56.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:56.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:57.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:57.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:57.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:57.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:58.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:58.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:58.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:58.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:59.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:48:59.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:48:59.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:48:59.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:00.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:00.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:00.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:00.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:01.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:01.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:01.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:01.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:02.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:02.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:02.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:02.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:03.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:03.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:03.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:03.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:04.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:04.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:04.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:04.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:05.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:05.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:05.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:05.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:06.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:06.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:06.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:06.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:07.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:07.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:07.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:07.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:08.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:08.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:08.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:08.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:09.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:09.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:10.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:10.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:10.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:10.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:11.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:11.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:11.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:11.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:12.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:12.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:12.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:12.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:13.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:13.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:13.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:13.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:14.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:14.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:14.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:14.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:15.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:15.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:15.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:15.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:16.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:16.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:16.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:16.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:17.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:17.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:17.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:17.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:18.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:18.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:18.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:18.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:19.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:19.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:19.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:19.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:20.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:20.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:20.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:20.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:21.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:21.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:21.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:21.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:22.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:22.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:22.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:22.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:23.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:23.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:23.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:23.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:24.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:24.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:24.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:24.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:25.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:25.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:25.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:25.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:26.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:26.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:26.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:26.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:27.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:27.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:27.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:27.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:28.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:28.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:28.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:28.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:29.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:29.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:29.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:29.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:30.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:30.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:30.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:30.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:31.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:31.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:31.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:31.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:32.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:32.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:32.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:32.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:33.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:33.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:33.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:33.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:34.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:34.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:34.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:34.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:35.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:35.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:35.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:35.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:36.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:36.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:36.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:36.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:36.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:36.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:37.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:37.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:38.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:38.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:38.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:38.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:39.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:39.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:39.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:39.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:40.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:40.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:40.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:40.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:41.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:41.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:41.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:41.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:42.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:42.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:42.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:42.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:43.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:43.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:43.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:43.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:44.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:44.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:44.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:44.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:45.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:45.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:45.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:45.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:46.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:46.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:46.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:46.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:47.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:47.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:47.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:47.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:48.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:48.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:48.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:48.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:49.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:49.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:49.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:49.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:50.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:50.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:50.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:50.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:51.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:51.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:51.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:51.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:52.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:52.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:52.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:52.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:53.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:53.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:53.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:53.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:54.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:54.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:54.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:54.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:55.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:55.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:55.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:55.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:56.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:56.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:57.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:56.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:57.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:57.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:58.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:58.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:58.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:58.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:59.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:59.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:49:59.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:49:59.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:00.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:49:59.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:00.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:00.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:01.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:00.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:01.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:01.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:01.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:01.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:02.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:02.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:03.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:03.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:03.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:03.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:04.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:04.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:04.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:04.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:05.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:05.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:05.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:05.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:06.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:06.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:06.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:06.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:07.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:07.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:07.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:07.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:08.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:08.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:08.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:08.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:09.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:09.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:09.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:09.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:10.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:10.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:10.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:10.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:10.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:10.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:11.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:11.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:11.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:11.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:12.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:12.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:12.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:12.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:13.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:13.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:13.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:13.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:14.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:13.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:14.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:14.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:14.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:14.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:15.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:15.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:15.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:15.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:16.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:16.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:16.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:16.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:17.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:17.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:17.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:17.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:18.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:18.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:18.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:18.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:19.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:19.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:20.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:20.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:20.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:20.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:20.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:20.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:21.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:21.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:21.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:21.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:22.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:22.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:22.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:22.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:23.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:23.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:23.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:23.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:24.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:24.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:24.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:24.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:25.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:25.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:25.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:25.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:26.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:26.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:26.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:26.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:27.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:27.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:27.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:27.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:28.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:28.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:28.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:28.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:29.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:29.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:29.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:29.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:30.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:30.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:30.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:30.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:31.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:31.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:31.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:31.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:32.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:32.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:32.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:32.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:33.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:33.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:33.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:33.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:34.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:34.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:34.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:34.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:35.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:35.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:35.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:35.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:36.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:36.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:36.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:36.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:37.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:37.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:37.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:37.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:38.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:38.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:38.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:38.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:39.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:39.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:39.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:39.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:40.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:40.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:40.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:40.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:41.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:41.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:42.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:41.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:42.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:42.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:42.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:42.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:43.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:43.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:43.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:43.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:44.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:44.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:44.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:44.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:45.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:45.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:45.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:45.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:46.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:46.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:46.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:46.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:47.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:47.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:47.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:47.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:48.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:48.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:48.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:48.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:49.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:49.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:49.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:49.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:50.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:50.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:50.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:50.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:51.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:51.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:51.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:51.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:52.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:52.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:52.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:52.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:53.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:53.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:53.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:53.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:54.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:54.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:54.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:54.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:55.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:55.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:56.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:55.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:56.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:56.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:57.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:57.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:57.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:57.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:58.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:58.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:58.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:58.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:59.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:50:59.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:50:59.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:50:59.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:00.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:00.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:00.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:00.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:01.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:01.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:01.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:01.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:02.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:02.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:02.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:02.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:03.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:03.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:03.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:03.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:04.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:04.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:04.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:04.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:05.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:05.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:05.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:05.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:06.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:06.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:06.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:06.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:07.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:07.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:07.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:07.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:08.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:08.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:08.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:08.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:09.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:09.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:09.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:09.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:10.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:10.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:10.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:10.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:11.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:11.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:11.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:11.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:12.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:12.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:12.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:12.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:13.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:13.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:13.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:13.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:14.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:14.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:14.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:14.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:15.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:15.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:15.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:15.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:16.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:16.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:16.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:16.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:17.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:17.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:17.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:17.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:18.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:18.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:18.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:18.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:19.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:19.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:19.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:19.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:20.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:20.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:20.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:20.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:21.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:21.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:21.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:21.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:22.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:22.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:22.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:22.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:23.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:23.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:23.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:23.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:24.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:24.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:24.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:24.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:25.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:25.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:25.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:25.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:26.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:26.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:26.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:26.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:27.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:27.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:27.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:27.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:28.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:28.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:28.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:28.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:29.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:29.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:29.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:29.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:30.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:30.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:30.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:30.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:31.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:31.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:31.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:31.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:32.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:32.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:32.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:32.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:33.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:33.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:33.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:33.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:34.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:34.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:34.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:34.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:35.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:35.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:35.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:35.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:36.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:36.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:36.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:36.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:37.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:37.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:37.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:37.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:38.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:38.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:38.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:38.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:39.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:39.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:39.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:39.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:40.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:40.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:40.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:40.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:41.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:41.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:41.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:41.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:42.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:42.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:42.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:42.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:43.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:43.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:43.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:43.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:44.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:44.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:44.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:44.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:45.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:45.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:45.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:45.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:46.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:46.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:46.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:46.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:47.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:47.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:47.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:47.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:48.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:48.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:48.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:48.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:49.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:49.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:49.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:49.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:50.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:50.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:50.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:50.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:51.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:51.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:51.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:51.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:52.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:52.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:52.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:52.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:53.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:53.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:53.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:53.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:54.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:54.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:54.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:54.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:55.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:55.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:55.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:55.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:56.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:56.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:56.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:56.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:57.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:57.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:57.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:57.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:58.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:58.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:58.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:58.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:59.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:51:59.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:51:59.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:51:59.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:00.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:00.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:00.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:00.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:01.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:01.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:01.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:01.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:02.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:02.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:02.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:02.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:03.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:03.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:03.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:03.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:04.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:04.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:04.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:04.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:05.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:05.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:05.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:05.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:06.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:06.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:06.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:06.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:07.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:07.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:07.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:07.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:08.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:08.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:08.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:08.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:09.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:09.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:09.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:09.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:10.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:10.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:10.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:10.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:11.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:11.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:11.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:11.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:12.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:12.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:12.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:12.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:13.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:13.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:13.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:13.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:14.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:14.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:14.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:14.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:15.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:15.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:15.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:15.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:16.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:16.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:16.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:16.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:17.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:17.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:17.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:17.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:18.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:18.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:18.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:18.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:19.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:19.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:19.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:19.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:20.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:20.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:20.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:20.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:21.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:21.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:21.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:21.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:22.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:22.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:22.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:22.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:23.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:23.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:23.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:23.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:24.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:24.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:24.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:24.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:25.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:25.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:25.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:25.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:26.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:26.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:26.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:26.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:27.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:27.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:27.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:27.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:28.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:28.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:28.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:28.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:29.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:29.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:29.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:29.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:30.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:30.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:30.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:30.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:31.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:31.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:31.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:31.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:32.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:32.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:32.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:32.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:33.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:33.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:33.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:33.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:34.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:34.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:34.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:34.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:35.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:35.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:35.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:35.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:36.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:36.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:36.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:36.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:37.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:37.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:37.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:37.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:38.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:38.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:38.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:38.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:39.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:39.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:39.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:39.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:40.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:40.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:40.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:40.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:41.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:41.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:41.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:41.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:42.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:42.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:42.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:42.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:43.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:43.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:43.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:43.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:44.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:44.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:44.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:44.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:45.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:45.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:45.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:45.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:46.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:46.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:46.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:46.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:47.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:47.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:47.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:47.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:48.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:48.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:48.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:48.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:49.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:49.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:49.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:49.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:50.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:50.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:50.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:50.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:51.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:51.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:51.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:51.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:52.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:52.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:52.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:52.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:53.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:53.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:53.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:53.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:54.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:54.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:54.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:54.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:55.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:55.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:55.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:55.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:56.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:56.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:56.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:56.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:57.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:57.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:57.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:57.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:58.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:58.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:58.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:58.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:59.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:52:59.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:52:59.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:52:59.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:00.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:00.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:00.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:00.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:01.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:01.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:01.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:01.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:02.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:02.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:02.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:02.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:03.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:03.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:03.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:03.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:04.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:04.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:04.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:04.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:05.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:05.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:05.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:05.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:06.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:06.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:06.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:06.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:07.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:07.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:07.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:07.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:08.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:08.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:08.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:08.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:09.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:09.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:09.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:09.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:10.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:10.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:10.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:10.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:11.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:11.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:11.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:11.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:12.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:12.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:12.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:12.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:13.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:13.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:13.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:13.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:14.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:14.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:14.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:14.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:15.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:15.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:15.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:15.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:16.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:16.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:16.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:16.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:17.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:17.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:17.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:17.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:18.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:18.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:18.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:18.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:19.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:19.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:19.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:19.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:20.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:20.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:20.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:20.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:21.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:21.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:21.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:21.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:22.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:22.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:22.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:22.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:23.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:23.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:23.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:23.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:24.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:24.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:24.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:24.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:25.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:25.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:25.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:25.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:26.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:26.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:26.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:26.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:27.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:27.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:27.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:27.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:28.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:28.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:28.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:28.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:29.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:29.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:29.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:29.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:30.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:30.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:30.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:30.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:31.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:31.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:31.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:31.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:32.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:32.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:32.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:32.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:33.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:33.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:33.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:33.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:34.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:34.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:34.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:34.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:35.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:35.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:35.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:35.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:36.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:36.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:36.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:36.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:37.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:37.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:37.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:37.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:38.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:38.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:38.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:38.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:39.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:39.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:39.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:39.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:40.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:40.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:40.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:40.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:41.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:41.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:41.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:41.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:42.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:42.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:42.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:42.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:43.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:43.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:43.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:43.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:44.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:44.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:44.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:44.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:45.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:45.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:45.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:45.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:46.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:46.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:46.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:46.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:47.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:47.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:47.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:47.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:48.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:48.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:48.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:48.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:49.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:49.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:49.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:49.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:50.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:50.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:50.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:50.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:51.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:51.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:51.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:51.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:52.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:52.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:52.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:52.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:53.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:53.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:53.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:53.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:54.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:54.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:54.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:54.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:55.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:55.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:55.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:55.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:56.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:56.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:56.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:56.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:57.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:57.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:58.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:58.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:58.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:58.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:59.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:53:59.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:53:59.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:53:59.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:00.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:00.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:00.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:00.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:01.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:01.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:01.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:01.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:02.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:02.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:02.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:02.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:03.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:03.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:03.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:03.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:04.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:04.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:04.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:04.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:05.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:05.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:05.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:05.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:06.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:06.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:06.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:06.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:07.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:07.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:07.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:07.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:08.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:08.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:08.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:08.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:09.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:09.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:09.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:09.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:10.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:10.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:10.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:10.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:11.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:11.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:11.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:11.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:12.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:12.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:12.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:12.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:13.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:13.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:13.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:13.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:14.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:14.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:14.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:14.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:15.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:15.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:15.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:15.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:16.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:16.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:16.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:16.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:17.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:17.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:17.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:17.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:18.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:18.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:18.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:18.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:19.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:19.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:19.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:19.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:20.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:20.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:20.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:20.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:21.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:21.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:21.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:21.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:22.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:22.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:22.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:22.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:23.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:23.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:23.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:23.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:24.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:24.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:24.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:24.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:25.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:25.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:25.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:25.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:26.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:26.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:26.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:26.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:27.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:27.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:27.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:27.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:28.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:28.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:28.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:28.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:29.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:29.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:29.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:29.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:30.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:30.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:30.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:30.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:31.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:31.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:31.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:31.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:32.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:32.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:32.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:32.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:33.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:33.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:33.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:33.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:34.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:34.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:34.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:34.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:35.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:35.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:35.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:35.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:36.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:36.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:36.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:36.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:37.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:37.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:37.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:37.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:38.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:38.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:38.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:38.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:39.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:39.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:39.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:39.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:40.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:40.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:40.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:40.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:41.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:41.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:41.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:41.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:42.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:42.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:42.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:42.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:43.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:43.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:43.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:43.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:44.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:44.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:44.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:44.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:45.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:45.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:45.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:45.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:46.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:46.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:46.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:46.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:47.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:47.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:47.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:47.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:48.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:48.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:48.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:48.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:49.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:49.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:49.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:49.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:50.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:50.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:50.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:50.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:51.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:51.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:51.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:51.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:52.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:52.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:52.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:52.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:53.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:53.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:53.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:53.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:54.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:54.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:54.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:54.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:55.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:55.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:55.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:55.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:56.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:56.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:56.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:57.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:57.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:57.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:57.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:58.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:58.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:58.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:58.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:59.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:54:59.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:54:59.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:54:59.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:00.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:00.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:00.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:00.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:01.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:01.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:01.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:01.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:02.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:02.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:02.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:02.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:03.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:03.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:03.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:03.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:04.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:04.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:04.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:04.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:05.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:05.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:05.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:05.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:06.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:06.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:06.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:06.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:07.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:07.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:07.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:07.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:08.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:08.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:08.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:08.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:09.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:09.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:09.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:09.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:10.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:10.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:10.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:10.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:11.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:11.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:11.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:11.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:12.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:12.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:12.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:12.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:13.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:13.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:13.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:13.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:14.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:14.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:14.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:14.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:15.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:15.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:15.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:15.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:16.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:16.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:16.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:16.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:17.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:17.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:17.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:17.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:18.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:18.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:18.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:18.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:19.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:19.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:19.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:19.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:20.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:20.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:20.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:20.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:21.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:21.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:21.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:21.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:22.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:22.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:22.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:22.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:23.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:23.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:23.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:23.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:24.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:24.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:24.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:24.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:25.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:25.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:25.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:25.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:26.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:26.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:26.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:26.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:27.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:27.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:27.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:27.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:28.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:28.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:28.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:28.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:29.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:29.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:29.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:29.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:30.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:30.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:30.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:30.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:31.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:31.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:31.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:31.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:32.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:32.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:32.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:32.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:33.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:33.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:33.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:33.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:34.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:34.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:34.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:34.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:35.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:35.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:35.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:35.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:36.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:36.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:36.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:36.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:37.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:37.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:37.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:37.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:38.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:38.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:38.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:38.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:39.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:39.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:39.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:39.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:40.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:40.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:40.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:40.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:41.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:41.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:41.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:41.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:42.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:42.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:42.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:42.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:43.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:43.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:43.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:43.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:44.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:44.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:44.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:44.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:45.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:45.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:45.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:45.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:46.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:46.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:46.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:46.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:47.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:47.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:47.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:47.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:48.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:48.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:48.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:48.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:49.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:49.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:49.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:49.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:50.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:50.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:50.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:50.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:51.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:51.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:51.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:51.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:52.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:52.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:52.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:52.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:53.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:53.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:53.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:53.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:54.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:54.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:54.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:54.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:55.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:55.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:55.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:55.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:56.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:56.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:56.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:56.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:57.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:57.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:57.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:57.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:58.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:58.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:58.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:58.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:59.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:55:59.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:55:59.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:55:59.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:00.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:00.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:00.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:00.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:01.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:01.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:01.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:01.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:02.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:02.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:02.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:02.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:03.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:03.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:03.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:03.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:04.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:04.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:04.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:04.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:05.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:05.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:05.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:05.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:06.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:06.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:06.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:06.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:07.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:07.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:07.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:07.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:08.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:08.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:08.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:08.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:09.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:09.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:09.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:09.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:10.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:10.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:10.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:10.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:11.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:11.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:11.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:11.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:12.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:12.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:12.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:12.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:13.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:13.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:13.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:13.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:14.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:14.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:14.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:14.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:15.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:15.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:15.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:15.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:16.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:16.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:16.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:16.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:17.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:17.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:17.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:17.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:18.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:18.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:18.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:18.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:19.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:19.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:19.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:19.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:20.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:20.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:20.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:20.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:21.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:21.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:21.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:21.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:22.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:22.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:22.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:22.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:23.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:23.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:23.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:23.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:24.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:24.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:24.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:24.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:25.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:25.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:25.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:25.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:26.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:26.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:26.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:26.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:27.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:27.094+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:27.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:27.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:28.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:28.118+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:28.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:28.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:29.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:29.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:29.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:29.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:30.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:30.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:30.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:30.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:31.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:31.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:31.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:31.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:32.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:32.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:32.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:32.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:33.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:33.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:33.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:33.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:34.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:34.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:34.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:34.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:35.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:35.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:35.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:35.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:36.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:36.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:36.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:36.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:37.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:37.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:37.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:37.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:38.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:38.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:38.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:38.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:39.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:39.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:39.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:39.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:40.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:40.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:40.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:40.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:41.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:41.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:41.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:41.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:42.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:42.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:42.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:42.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:43.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:43.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:43.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:43.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:44.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:44.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:44.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:44.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:45.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:45.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:45.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:45.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:46.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:46.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:46.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:46.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:47.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:47.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:47.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:47.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:48.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:48.142+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:48.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:48.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:49.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:49.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:49.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:49.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:50.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:50.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:50.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:50.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:51.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:51.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:51.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:51.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:52.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:52.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:52.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:52.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:53.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:53.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:53.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:53.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:54.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:54.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:54.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:54.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:55.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:55.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:55.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:55.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:56.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:56.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:56.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:56.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:57.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:57.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:57.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:57.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:58.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:58.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:58.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:58.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:59.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:56:59.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:56:59.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:56:59.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:00.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:00.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:00.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:00.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:01.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:01.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:01.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:01.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:02.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:02.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:02.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:02.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:03.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:03.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:03.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:03.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:04.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:04.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:04.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:04.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:05.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:05.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:05.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:05.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:06.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:06.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:06.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:06.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:07.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:07.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:07.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:07.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:08.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:08.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:08.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:08.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:09.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:09.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:09.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:09.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:10.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:10.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:10.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:10.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:11.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:11.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:11.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:11.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:12.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:12.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:12.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:12.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:13.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:13.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:13.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:13.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:14.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:14.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:14.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:14.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:15.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:15.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:15.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:15.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:16.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:16.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:16.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:16.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:17.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:17.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:17.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:17.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:18.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:18.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:18.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:18.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:19.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:19.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:19.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:19.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:20.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:20.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:20.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:20.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:21.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:21.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:21.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:21.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:22.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:22.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:22.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:22.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:23.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:23.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:23.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:23.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:24.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:24.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:24.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:24.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:25.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:25.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:25.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:25.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:26.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:26.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:26.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:26.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:27.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:27.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:27.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:27.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:28.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:28.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:28.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:28.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:29.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:29.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:29.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:29.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:30.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:30.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:30.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:30.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:31.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:31.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:31.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:31.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:32.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:32.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:32.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:32.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:33.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:33.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:33.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:33.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:34.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:34.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:34.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:34.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:35.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:35.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:35.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:35.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:36.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:36.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:36.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:36.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:37.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:37.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:37.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:37.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:38.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:38.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:38.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:38.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:39.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:39.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:39.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:39.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:40.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:40.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:40.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:40.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:41.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:41.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:41.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:41.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:42.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:42.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:42.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:42.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:43.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:43.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:43.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:43.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:44.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:44.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:44.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:44.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:45.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:45.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:45.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:45.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:46.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:46.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:46.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:46.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:47.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:47.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:47.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:47.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:48.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:48.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:48.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:48.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:49.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:49.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:49.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:49.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:50.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:50.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:50.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:50.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:51.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:51.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:51.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:51.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:52.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:52.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:52.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:53.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:53.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:53.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:53.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:54.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:54.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:54.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:54.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:55.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:55.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:55.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:55.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:56.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:56.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:56.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:56.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:57.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:57.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:57.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:57.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:58.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:58.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:58.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:58.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:59.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:57:59.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:57:59.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:57:59.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:00.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:00.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:00.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:00.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:01.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:01.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:01.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:01.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:02.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:02.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:02.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:02.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:03.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:03.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:03.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:03.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:04.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:04.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:04.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:04.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:05.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:05.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:05.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:05.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:06.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:06.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:06.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:06.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:07.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:07.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:07.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:07.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:08.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:08.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:08.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:08.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:09.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:09.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:09.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:09.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:10.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:10.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:10.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:10.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:11.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:11.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:11.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:11.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:12.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:12.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:12.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:12.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:13.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:13.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:13.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:13.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:14.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:14.152+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:14.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:14.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:15.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:15.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:15.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:15.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:16.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:16.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:16.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:16.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:17.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:17.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:17.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:17.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:18.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:18.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:18.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:18.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:19.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:19.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:19.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:19.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:20.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:20.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:20.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:20.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:21.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:21.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:21.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:21.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:22.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:22.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:22.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:22.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:23.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:23.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:23.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:23.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:24.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:24.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:24.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:24.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:25.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:25.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:25.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:25.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:26.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:26.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:26.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:26.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:27.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:27.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:27.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:27.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:28.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:28.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:28.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:28.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:29.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:29.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:29.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:29.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:30.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:30.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:30.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:30.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:31.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:31.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:31.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:31.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:32.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:32.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:32.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:32.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:33.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:33.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:33.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:33.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:34.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:34.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:34.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:34.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:35.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:35.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:35.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:35.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:36.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:36.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:36.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:36.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:37.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:37.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:37.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:37.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:38.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:38.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:38.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:39.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:39.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:39.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:39.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:40.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:40.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:40.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:40.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:41.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:41.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:41.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:41.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:42.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:42.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:42.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:42.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:43.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:43.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:43.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:43.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:44.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:44.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:44.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:44.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:45.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:45.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:45.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:45.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:46.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:46.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:46.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:46.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:47.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:47.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:47.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:47.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:48.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:48.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:48.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:48.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:49.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:49.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:49.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:49.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:50.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:50.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:50.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:50.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:51.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:51.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:51.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:51.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:52.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:52.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:52.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:52.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:53.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:53.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:53.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:53.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:54.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:54.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:54.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:54.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:55.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:55.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:55.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:55.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:56.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:56.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:56.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:56.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:57.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:57.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:57.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:57.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:58.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:58.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:58.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:58.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:59.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:58:59.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:58:59.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:58:59.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:00.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:00.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:00.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:00.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:01.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:01.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:01.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:01.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:02.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:02.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:02.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:02.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:03.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:03.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:03.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:03.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:04.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:04.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:04.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:04.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:05.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:05.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:05.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:05.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:06.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:06.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:06.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:06.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:07.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:07.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:07.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:07.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:08.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:08.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:08.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:08.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:09.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:09.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:09.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:09.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:10.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:10.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:10.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:10.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:11.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:11.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:11.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:11.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:12.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:12.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:12.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:12.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:13.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:13.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:13.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:13.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:14.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:14.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:14.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:14.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:15.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:15.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:15.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:15.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:16.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:16.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:16.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:16.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:17.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:17.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:17.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:17.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:18.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:18.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:18.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:18.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:19.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:19.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:19.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:19.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:20.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:20.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:20.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:20.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:21.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:21.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:21.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:21.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:22.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:22.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:22.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:22.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:23.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:23.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:23.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:23.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:24.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:24.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:24.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:24.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:25.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:25.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:25.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:25.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:26.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:26.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:26.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:26.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:27.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:27.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:27.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:27.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:28.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:28.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:28.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:28.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:29.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:29.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:29.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:29.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:30.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:30.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:30.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:30.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:31.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:31.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:31.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:31.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:32.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:32.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:32.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:32.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:33.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:33.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:33.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:33.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:34.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:34.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:34.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:34.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:35.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:35.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:35.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:35.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:36.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:36.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:36.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:36.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:37.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:37.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:37.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:37.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:38.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:38.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:38.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:38.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:39.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:39.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:39.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:39.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:40.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:40.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:40.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:40.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:41.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:41.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:41.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:41.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:42.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:42.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:42.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:42.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:43.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:43.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:43.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:43.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:44.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:44.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:44.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:44.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:45.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:45.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:45.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:45.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:46.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:46.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:46.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:46.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:47.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:47.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:47.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:47.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:48.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:48.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:48.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:48.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:49.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:49.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:49.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:49.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:50.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:50.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:50.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:50.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:51.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:51.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:51.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:51.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:52.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:52.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:52.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:52.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:53.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:53.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:53.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:53.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:54.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:54.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:54.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:54.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:55.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:55.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:55.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:55.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:56.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:56.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:56.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:56.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:57.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:57.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:57.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:57.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:58.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:58.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:58.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:58.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:59.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T05:59:59.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T05:59:59.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T05:59:59.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:00.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:00.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:00.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:00.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:01.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:01.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:01.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:01.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:02.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:02.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:03.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:03.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:03.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:03.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:03.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:03.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:04.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:04.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:04.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:04.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:05.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:05.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:05.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:05.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:06.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:06.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:07.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:06.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:07.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:07.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:07.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:07.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:08.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:08.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:08.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:08.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:09.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:09.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:09.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:09.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:10.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:10.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:10.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:10.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:11.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:11.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:11.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:11.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:12.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:12.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:12.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:12.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:13.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:13.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:13.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:13.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:14.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:14.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:15.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:15.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:15.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:15.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:16.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:16.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:16.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:16.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:17.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:17.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:17.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:17.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:18.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:18.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:18.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:18.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:19.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:19.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:19.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:19.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:20.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:20.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:20.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:20.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:21.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:21.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:21.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:21.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:22.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:22.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:22.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:22.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:23.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:23.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:23.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:23.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:24.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:24.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:24.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:24.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:25.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:25.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:25.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:25.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:26.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:26.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:26.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:26.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:27.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:27.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:27.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:27.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:28.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:28.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:28.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:28.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:29.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:29.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:29.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:29.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:30.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:30.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:30.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:30.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:31.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:31.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:31.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:31.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:32.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:32.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:32.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:32.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:33.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:33.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:33.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:33.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:34.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:34.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:34.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:34.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:35.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:35.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:35.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:35.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:36.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:36.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:36.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:36.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:37.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:37.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:37.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:37.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:38.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:38.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:38.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:38.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:39.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:39.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:39.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:39.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:40.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:40.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:40.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:40.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:41.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:41.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:41.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:41.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:42.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:42.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:42.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:42.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:43.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:43.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:43.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:43.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:44.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:44.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:44.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:44.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:45.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:45.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:45.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:45.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:46.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:46.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:46.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:46.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:47.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:47.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:47.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:47.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:48.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:48.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:48.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:48.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:49.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:49.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:49.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:49.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:50.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:50.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:50.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:50.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:51.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:51.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:51.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:51.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:52.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:52.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:52.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:52.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:53.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:53.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:53.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:53.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:54.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:54.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:54.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:54.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:55.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:55.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:55.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:55.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:56.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:56.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:56.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:56.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:57.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:57.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:57.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:57.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:58.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:58.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:58.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:58.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:59.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:00:59.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:00:59.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:00:59.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:00.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:00.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:00.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:00.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:01.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:01.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:01.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:01.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:02.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:02.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:02.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:02.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:03.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:02.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:03.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:03.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:03.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:03.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:04.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:04.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:04.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:04.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:05.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:05.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:05.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:05.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:06.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:06.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:06.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:06.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:07.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:07.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:07.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:07.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:08.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:08.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:08.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:08.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:09.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:09.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:09.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:09.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:10.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:10.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:10.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:10.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:11.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:11.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:11.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:11.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:12.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:12.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:12.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:12.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:13.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:13.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:13.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:13.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:14.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:14.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:14.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:14.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:15.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:15.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:15.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:15.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:16.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:16.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:16.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:16.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:17.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:17.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:17.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:17.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:18.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:18.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:18.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:18.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:19.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:19.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:19.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:19.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:20.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:20.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:20.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:20.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:21.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:21.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:21.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:21.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:22.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:22.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:22.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:22.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:23.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:23.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:24.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:24.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:24.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:24.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:25.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:25.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:25.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:25.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:25.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:25.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:26.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:26.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:26.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:26.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:27.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:27.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:28.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:28.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:28.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:28.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:29.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:29.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:29.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:29.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:30.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:30.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:30.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:30.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:31.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:31.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:31.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:31.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:32.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:32.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:32.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:32.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:33.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:33.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:33.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:33.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:34.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:34.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:34.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:34.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:35.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:35.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:35.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:35.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:36.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:36.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:36.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:36.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:37.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:37.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:37.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:37.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:38.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:38.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:38.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:38.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:39.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:39.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:39.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:39.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:40.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:40.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:40.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:40.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:41.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:41.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:41.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:41.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:42.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:42.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:42.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:42.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:43.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:43.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:43.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:43.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:44.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:44.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:44.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:44.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:45.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:45.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:45.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:45.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:46.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:46.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:46.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:46.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:47.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:47.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:47.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:47.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:48.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:48.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:48.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:48.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:49.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:49.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:49.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:49.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:50.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:50.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:50.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:50.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:51.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:51.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:51.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:51.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:52.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:52.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:52.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:52.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:53.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:53.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:53.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:53.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:54.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:54.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:54.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:54.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:55.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:55.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:55.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:55.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:56.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:56.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:56.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:56.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:57.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:57.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:57.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:57.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:58.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:58.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:58.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:58.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:59.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:01:59.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:01:59.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:01:59.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:00.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:00.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:00.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:00.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:01.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:01.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:01.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:01.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:02.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:02.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:02.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:02.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:03.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:03.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:03.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:03.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:04.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:04.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:04.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:04.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:05.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:05.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:05.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:05.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:06.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:06.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:06.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:06.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:07.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:07.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:07.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:07.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:08.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:08.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:08.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:08.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:09.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:09.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:09.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:09.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:10.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:10.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:10.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:10.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:11.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:11.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:11.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:11.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:12.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:12.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:12.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:12.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:13.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:13.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:13.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:13.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:14.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:14.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:14.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:14.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:15.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:15.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:15.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:15.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:16.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:16.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:16.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:16.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:17.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:17.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:17.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:17.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:18.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:18.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:18.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:18.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:19.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:19.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:19.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:19.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:20.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:20.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:20.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:20.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:21.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:21.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:21.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:21.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:22.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:22.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:22.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:22.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:23.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:23.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:23.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:23.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:24.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:24.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:24.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:24.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:25.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:25.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:25.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:25.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:26.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:26.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:26.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:26.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:27.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:27.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:27.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:27.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:28.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:28.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:28.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:28.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:29.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:29.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:29.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:29.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:30.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:30.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:30.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:30.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:31.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:31.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:31.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:31.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:32.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:32.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:32.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:32.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:33.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:33.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:33.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:33.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:34.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:34.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:34.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:34.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:35.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:35.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:35.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:35.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:36.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:36.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:36.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:36.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:37.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:37.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:37.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:37.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:38.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:38.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:38.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:38.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:39.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:39.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:39.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:39.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:40.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:40.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:40.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:40.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:41.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:41.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:41.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:41.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:42.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:42.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:42.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:42.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:43.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:43.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:43.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:43.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:44.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:44.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:44.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:44.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:45.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:45.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:45.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:45.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:46.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:46.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:46.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:46.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:47.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:47.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:47.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:47.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:48.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:48.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:48.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:48.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:49.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:49.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:49.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:49.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:50.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:50.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:50.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:50.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:51.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:51.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:51.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:51.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:52.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:52.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:52.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:52.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:53.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:53.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:53.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:53.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:54.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:54.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:54.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:54.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:55.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:55.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:55.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:55.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:56.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:56.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:56.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:56.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:57.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:57.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:57.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:57.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:58.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:58.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:58.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:58.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:59.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:02:59.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:02:59.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:02:59.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:00.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:00.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:00.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:00.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:01.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:01.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:01.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:01.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:02.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:02.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:02.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:02.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:03.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:03.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:03.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:03.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:04.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:04.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:04.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:04.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:05.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:05.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:05.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:05.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:06.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:06.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:06.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:06.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:07.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:07.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:07.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:07.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:08.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:08.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:08.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:08.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:09.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:09.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:09.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:09.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:10.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:10.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:10.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:10.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:11.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:11.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:11.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:11.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:12.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:12.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:12.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:12.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:13.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:13.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:13.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:13.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:14.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:14.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:14.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:14.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:15.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:15.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:15.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:15.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:16.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:16.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:16.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:16.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:17.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:17.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:17.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:17.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:18.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:18.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:18.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:18.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:19.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:19.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:19.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:19.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:20.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:20.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:20.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:20.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:21.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:21.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:21.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:21.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:22.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:22.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:22.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:22.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:23.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:23.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:23.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:23.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:24.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:24.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:24.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:24.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:25.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:25.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:25.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:25.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:26.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:26.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:26.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:26.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:27.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:27.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:27.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:27.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:28.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:28.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:28.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:28.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:29.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:29.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:29.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:29.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:30.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:30.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:30.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:30.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:31.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:31.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:31.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:31.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:32.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:32.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:32.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:32.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:33.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:33.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:33.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:33.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:34.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:34.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:34.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:34.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:35.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:35.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:35.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:35.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:36.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:36.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:36.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:36.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:37.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:37.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:37.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:37.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:38.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:38.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:38.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:38.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:39.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:39.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:39.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:39.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:40.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:40.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:40.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:40.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:41.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:41.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:41.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:41.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:42.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:42.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:42.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:42.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:43.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:43.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:43.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:43.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:44.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:44.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:44.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:44.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:45.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:45.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:45.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:45.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:46.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:46.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:46.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:46.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:47.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:47.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:47.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:47.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:48.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:48.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:48.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:48.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:49.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:49.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:49.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:49.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:50.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:50.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:50.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:50.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:51.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:51.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:51.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:51.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:52.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:52.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:52.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:52.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:53.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:53.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:53.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:53.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:54.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:54.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:54.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:54.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:55.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:55.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:55.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:55.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:56.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:56.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:56.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:56.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:57.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:57.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:57.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:57.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:58.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:58.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:58.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:58.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:59.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:03:59.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:03:59.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:03:59.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:00.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:00.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:00.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:00.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:01.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:01.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:01.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:01.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:02.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:02.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:02.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:02.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:03.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:03.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:03.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:03.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:04.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:04.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:04.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:04.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:05.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:05.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:05.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:05.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:06.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:06.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:06.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:06.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:07.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:07.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:07.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:07.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:08.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:08.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:08.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:08.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:09.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:09.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:09.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:09.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:10.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:10.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:10.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:10.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:11.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:11.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:11.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:11.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:12.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:12.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:12.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:12.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:13.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:13.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:13.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:13.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:14.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:14.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:14.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:14.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:15.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:15.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:15.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:15.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:16.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:16.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:16.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:16.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:17.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:17.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:17.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:17.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:18.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:18.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:18.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:18.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:19.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:19.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:19.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:19.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:20.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:20.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:20.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:20.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:21.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:21.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:21.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:21.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:22.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:22.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:22.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:22.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:23.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:23.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:23.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:23.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:24.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:24.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:24.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:24.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:25.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:25.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:25.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:25.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:26.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:26.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:26.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:26.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:27.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:27.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:27.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:27.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:28.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:28.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:28.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:28.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:29.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:29.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:29.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:29.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:30.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:30.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:30.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:30.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:31.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:31.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:31.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:31.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:32.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:32.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:32.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:32.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:33.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:33.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:33.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:33.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:34.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:34.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:34.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:34.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:35.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:35.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:35.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:35.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:36.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:36.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:36.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:36.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:37.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:37.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:37.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:37.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:38.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:38.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:38.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:38.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:39.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:39.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:39.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:39.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:40.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:40.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:40.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:40.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:41.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:41.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:41.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:41.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:42.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:42.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:42.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:42.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:43.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:43.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:43.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:43.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:44.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:44.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:44.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:44.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:45.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:45.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:45.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:45.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:46.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:46.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:46.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:46.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:47.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:47.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:47.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:47.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:48.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:48.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:48.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:48.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:49.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:49.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:49.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:49.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:50.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:50.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:50.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:50.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:51.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:51.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:51.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:51.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:52.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:52.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:52.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:52.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:53.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:53.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:53.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:53.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:54.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:54.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:54.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:54.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:55.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:55.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:55.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:55.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:56.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:56.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:56.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:56.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:57.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:57.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:57.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:57.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:58.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:58.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:58.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:58.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:59.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:04:59.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:04:59.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:04:59.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:00.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:00.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:00.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:00.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:01.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:01.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:01.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:01.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:02.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:02.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:02.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:02.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:03.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:03.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:03.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:03.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:04.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:04.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:04.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:04.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:05.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:05.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:05.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:05.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:06.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:06.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:06.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:06.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:07.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:07.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:07.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:07.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:08.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:08.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:08.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:08.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:09.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:09.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:09.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:09.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:10.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:10.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:10.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:10.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:11.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:11.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:11.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:11.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:12.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:12.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:12.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:12.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:13.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:13.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:13.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:13.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:14.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:14.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:14.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:14.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:15.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:15.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:15.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:15.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:16.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:16.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:16.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:16.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:17.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:17.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:17.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:17.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:18.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:18.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:18.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:18.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:19.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:19.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:19.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:19.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:20.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:20.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:20.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:20.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:21.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:21.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:21.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:21.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:22.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:22.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:22.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:22.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:23.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:23.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:23.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:23.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:24.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:24.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:24.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:24.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:25.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:25.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:25.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:25.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:26.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:26.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:26.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:26.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:27.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:27.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:27.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:27.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:28.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:28.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:29.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:29.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:29.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:29.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:30.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:30.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:30.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:30.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:31.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:31.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:31.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:31.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:31.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:31.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:32.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:32.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:32.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:33.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:33.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:34.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:34.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:34.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:34.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:35.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:35.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:35.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:35.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:35.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:35.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:36.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:36.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:36.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:36.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:37.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:37.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:37.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:37.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:38.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:38.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:38.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:38.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:39.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:39.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:39.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:39.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:40.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:40.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:40.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:40.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:41.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:41.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:41.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:41.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:42.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:42.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:42.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:42.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:43.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:43.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:43.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:43.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:44.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:44.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:44.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:44.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:45.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:45.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:45.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:45.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:46.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:46.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:46.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:46.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:47.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:47.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:47.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:47.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:48.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:48.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:48.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:48.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:49.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:49.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:49.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:49.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:50.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:50.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:50.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:50.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:51.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:51.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:51.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:51.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:52.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:52.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:52.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:52.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:53.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:53.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:54.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:54.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:54.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:54.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:54.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:54.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:55.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:55.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:55.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:55.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:56.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:56.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:56.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:56.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:57.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:57.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:57.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:57.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:58.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:58.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:58.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:58.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:59.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:05:59.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:05:59.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:05:59.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:00.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:00.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:00.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:00.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:01.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:01.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:01.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:01.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:02.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:02.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:02.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:02.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:03.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:03.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:04.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:04.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:04.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:04.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:04.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:04.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:05.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:05.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:05.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:05.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:07.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:06.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:07.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:07.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:07.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:07.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:08.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:08.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:08.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:08.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:08.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:08.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:09.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:09.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:09.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:09.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:10.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:10.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:11.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:11.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:11.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:11.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:12.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:12.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:12.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:12.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:13.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:13.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:13.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:13.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:14.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:14.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:14.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:14.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:15.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:15.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:15.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:15.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:16.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:16.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:16.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:16.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:17.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:17.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:17.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:17.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:18.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:18.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:18.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:18.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:19.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:19.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:19.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:19.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:20.053 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:20.044+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:20.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:20.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:21.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:21.040+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:21.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:21.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:22.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:22.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:22.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:22.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:23.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:23.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:23.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:23.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:24.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:24.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:24.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:24.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:25.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:25.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:25.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:25.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:26.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:26.228+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:26.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:26.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:27.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:27.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:28.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:27.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:28.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:28.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:28.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:28.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:29.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:29.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:29.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:29.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:30.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:30.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:30.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:30.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:31.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:31.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:31.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:31.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:32.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:32.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:32.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:32.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:33.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:33.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:33.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:33.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:34.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:34.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:34.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:34.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:35.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:35.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:35.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:35.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:36.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:36.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:36.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:36.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:37.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:37.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:37.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:37.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:38.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:38.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:38.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:38.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:39.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:39.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:40.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:40.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:40.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:40.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:41.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:41.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:41.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:41.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:42.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:42.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:42.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:42.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:43.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:43.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:43.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:43.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:44.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:44.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:44.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:44.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:45.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:45.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:45.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:45.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:46.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:46.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:46.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:46.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:47.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:47.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:47.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:47.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:48.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:48.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:48.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:48.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:49.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:49.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:49.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:49.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:50.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:50.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:50.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:50.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:51.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:51.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:51.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:51.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:52.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:52.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:52.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:52.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:53.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:53.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:53.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:53.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:54.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:54.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:54.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:54.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:55.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:55.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:55.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:55.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:56.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:56.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:56.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:56.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:57.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:57.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:57.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:57.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:58.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:58.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:58.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:58.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:59.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:06:59.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:06:59.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:06:59.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:00.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:00.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:00.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:00.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:01.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:01.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:01.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:01.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:02.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:02.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:02.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:02.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:03.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:03.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:03.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:03.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:04.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:04.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:04.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:04.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:05.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:05.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:05.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:05.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:06.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:06.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:06.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:06.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:07.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:07.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:07.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:07.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:08.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:08.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:08.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:08.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:09.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:09.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:09.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:09.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:10.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:10.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:10.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:10.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:11.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:11.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:11.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:11.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:12.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:12.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:12.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:12.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:13.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:13.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:13.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:13.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:14.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:14.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:14.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:14.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:15.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:15.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:15.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:15.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:16.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:16.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:16.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:16.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:17.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:17.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:17.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:17.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:18.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:18.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:18.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:18.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:19.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:19.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:19.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:19.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:20.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:20.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:20.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:20.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:21.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:21.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:21.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:21.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:22.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:22.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:22.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:22.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:23.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:23.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:23.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:23.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:24.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:24.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:24.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:24.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:25.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:25.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:25.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:25.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:26.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:26.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:26.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:26.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:27.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:27.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:27.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:27.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:28.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:28.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:28.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:28.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:29.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:29.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:29.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:29.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:30.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:30.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:30.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:30.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:31.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:31.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:31.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:31.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:32.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:32.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:32.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:32.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:33.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:33.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:33.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:33.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:34.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:34.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:34.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:34.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:35.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:35.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:35.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:35.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:36.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:36.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:36.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:36.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:37.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:37.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:37.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:37.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:38.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:38.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:38.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:38.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:39.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:39.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:39.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:39.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:40.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:40.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:40.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:40.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:41.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:41.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:41.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:41.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:42.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:42.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:42.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:42.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:43.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:43.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:43.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:43.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:44.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:44.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:44.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:44.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:45.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:45.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:45.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:45.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:46.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:46.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:46.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:46.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:47.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:47.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:47.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:47.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:48.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:48.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:48.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:48.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:49.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:49.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:49.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:49.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:50.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:50.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:50.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:50.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:51.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:51.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:51.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:51.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:52.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:52.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:52.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:52.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:53.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:53.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:53.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:53.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:54.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:54.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:54.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:54.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:55.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:55.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:55.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:55.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:56.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:56.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:56.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:56.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:57.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:57.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:57.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:57.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:58.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:58.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:58.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:58.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:59.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:07:59.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:07:59.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:07:59.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:00.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:00.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:00.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:00.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:01.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:01.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:01.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:01.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:02.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:02.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:02.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:02.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:03.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:03.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:03.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:03.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:04.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:04.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:04.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:04.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:05.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:05.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:05.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:05.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:06.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:06.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:06.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:06.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:07.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:07.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:07.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:07.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:08.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:08.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:08.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:08.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:09.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:09.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:09.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:09.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:10.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:10.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:10.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:10.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:11.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:11.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:11.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:11.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:12.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:12.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:12.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:12.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:13.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:13.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:13.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:13.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:14.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:14.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:14.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:14.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:15.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:15.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:15.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:15.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:16.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:16.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:16.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:16.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:17.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:17.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:17.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:17.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:18.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:18.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:18.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:18.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:19.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:19.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:19.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:19.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:20.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:20.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:20.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:20.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:21.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:21.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:21.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:21.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:22.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:22.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:22.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:22.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:23.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:23.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:23.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:23.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:24.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:24.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:24.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:24.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:25.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:25.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:25.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:25.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:26.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:26.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:26.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:26.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:27.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:27.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:27.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:27.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:28.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:28.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:28.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:28.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:29.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:29.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:29.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:29.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:30.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:30.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:30.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:30.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:31.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:31.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:31.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:31.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:32.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:32.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:32.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:32.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:33.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:33.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:33.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:33.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:34.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:34.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:34.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:34.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:35.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:35.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:35.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:35.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:36.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:36.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:36.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:36.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:37.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:37.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:37.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:37.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:38.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:38.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:38.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:38.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:39.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:39.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:39.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:39.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:40.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:40.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:40.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:40.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:41.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:41.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:41.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:41.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:42.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:42.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:42.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:42.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:43.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:43.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:43.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:43.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:44.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:44.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:45.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:44.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:45.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:45.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:45.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:45.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:46.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:46.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:46.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:46.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:47.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:47.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:47.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:47.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:48.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:48.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:48.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:48.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:49.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:49.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:49.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:49.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:50.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:50.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:50.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:50.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:51.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:51.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:51.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:51.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:52.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:52.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:52.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:52.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:53.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:53.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:53.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:53.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:54.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:54.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:54.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:54.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:55.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:55.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:55.974 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:55.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:56.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:56.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:56.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:56.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:57.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:57.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:57.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:57.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:58.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:58.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:59.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:08:59.032+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:08:59.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:08:59.556+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:00.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:00.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:00.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:00.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:01.028 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:01.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:01.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:01.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:02.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:02.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:02.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:02.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:03.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:03.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:03.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:03.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:04.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:04.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:04.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:04.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:05.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:05.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:05.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:05.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:06.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:06.000+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:06.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:06.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:06.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:06.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:07.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:07.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:07.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:07.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:08.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:08.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:09.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:09.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:09.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:09.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:10.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:10.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:10.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:10.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:11.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:11.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:11.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:11.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:12.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:12.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:12.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:12.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:13.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:13.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:13.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:13.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:14.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:14.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:14.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:14.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:15.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:15.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:15.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:15.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:16.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:16.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:16.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:16.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:17.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:17.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:17.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:17.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:18.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:18.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:18.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:18.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:19.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:19.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:19.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:19.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:20.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:20.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:20.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:20.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:21.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:21.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:21.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:21.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:22.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:22.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:22.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:22.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:23.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:23.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:23.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:23.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:24.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:24.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:24.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:24.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:25.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:25.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:25.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:25.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:26.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:26.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:26.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:26.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:27.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:27.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:27.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:27.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:28.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:28.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:28.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:28.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:29.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:29.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:29.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:29.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:30.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:30.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:30.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:30.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:31.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:31.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:31.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:31.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:32.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:32.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:32.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:32.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:33.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:33.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:33.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:33.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:34.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:34.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:34.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:34.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:35.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:35.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:35.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:35.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:36.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:36.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:36.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:36.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:37.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:37.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:37.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:37.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:38.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:38.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:38.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:38.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:39.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:39.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:39.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:39.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:40.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:40.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:40.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:40.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:41.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:41.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:41.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:41.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:42.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:42.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:42.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:42.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:43.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:43.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:43.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:43.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:44.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:44.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:44.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:44.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:45.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:45.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:45.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:45.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:46.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:46.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:46.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:46.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:47.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:47.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:47.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:47.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:48.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:48.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:48.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:48.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:49.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:49.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:49.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:49.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:50.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:50.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:50.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:50.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:51.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:51.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:51.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:51.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:52.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:52.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:52.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:52.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:53.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:53.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:53.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:53.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:54.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:54.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:54.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:54.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:55.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:55.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:55.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:55.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:56.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:56.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:56.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:56.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:57.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:57.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:57.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:57.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:58.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:58.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:58.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:58.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:59.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:09:59.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:09:59.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:09:59.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:00.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:00.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:00.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:00.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:01.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:01.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:01.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:01.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:02.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:02.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:02.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:02.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:03.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:03.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:03.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:03.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:04.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:04.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:04.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:04.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:05.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:05.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:05.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:05.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:06.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:06.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:06.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:06.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:07.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:07.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:07.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:07.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:08.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:08.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:08.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:08.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:09.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:09.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:09.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:09.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:10.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:10.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:10.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:10.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:11.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:11.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:11.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:11.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:12.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:12.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:12.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:12.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:13.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:13.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:13.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:13.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:14.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:14.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:14.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:14.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:15.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:15.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:15.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:15.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:16.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:16.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:16.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:16.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:17.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:17.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:17.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:17.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:18.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:18.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:18.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:18.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:19.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:19.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:19.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:19.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:20.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:20.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:20.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:20.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:21.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:21.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:21.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:21.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:22.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:22.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:22.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:22.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:23.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:23.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:23.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:23.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:24.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:24.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:24.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:24.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:25.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:25.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:25.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:25.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:26.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:26.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:26.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:26.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:27.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:27.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:27.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:27.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:28.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:28.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:28.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:28.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:29.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:29.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:29.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:29.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:30.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:30.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:30.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:30.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:31.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:31.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:31.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:31.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:32.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:32.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:32.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:32.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:33.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:33.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:33.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:33.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:34.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:34.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:34.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:34.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:35.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:35.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:35.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:35.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:36.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:36.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:36.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:36.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:37.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:37.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:37.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:37.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:38.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:38.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:38.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:38.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:39.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:39.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:39.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:39.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:40.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:40.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:40.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:40.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:41.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:41.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:41.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:41.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:42.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:42.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:42.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:42.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:43.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:43.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:43.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:43.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:44.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:44.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:44.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:44.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:45.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:45.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:45.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:45.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:46.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:46.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:46.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:46.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:47.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:47.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:47.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:47.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:48.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:48.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:48.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:48.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:49.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:49.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:49.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:49.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:50.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:50.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:50.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:50.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:51.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:51.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:51.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:51.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:52.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:52.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:52.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:52.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:53.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:53.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:53.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:53.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:54.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:54.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:54.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:54.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:55.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:55.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:55.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:55.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:56.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:56.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:56.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:56.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:57.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:57.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:57.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:57.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:58.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:58.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:58.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:58.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:59.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:10:59.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:10:59.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:10:59.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:00.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:00.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:00.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:00.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:01.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:01.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:01.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:01.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:02.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:02.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:02.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:02.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:03.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:03.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:03.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:03.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:04.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:04.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:04.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:04.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:05.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:05.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:05.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:05.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:06.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:06.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:06.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:06.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:07.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:07.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:07.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:07.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:08.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:08.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:08.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:08.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:09.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:09.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:09.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:09.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:10.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:10.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:10.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:10.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:11.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:11.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:11.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:11.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:12.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:12.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:12.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:12.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:13.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:13.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:13.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:13.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:14.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:14.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:14.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:14.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:15.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:15.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:15.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:15.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:16.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:16.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:16.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:16.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:17.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:17.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:17.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:17.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:18.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:18.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:18.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:18.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:19.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:19.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:19.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:19.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:20.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:20.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:20.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:20.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:21.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:21.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:21.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:21.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:22.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:22.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:22.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:22.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:23.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:23.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:23.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:23.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:24.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:24.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:24.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:24.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:25.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:25.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:25.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:25.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:26.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:26.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:26.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:26.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:27.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:27.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:27.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:27.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:28.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:28.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:28.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:28.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:29.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:29.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:29.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:29.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:30.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:30.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:30.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:30.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:31.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:31.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:31.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:31.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:32.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:32.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:32.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:32.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:33.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:33.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:33.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:33.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:34.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:34.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:34.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:34.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:35.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:35.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:35.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:35.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:36.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:36.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:36.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:36.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:37.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:37.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:37.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:37.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:38.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:38.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:38.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:38.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:39.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:39.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:39.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:39.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:40.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:40.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:40.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:40.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:41.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:41.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:41.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:41.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:42.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:42.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:42.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:42.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:43.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:43.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:43.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:43.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:44.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:44.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:44.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:44.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:45.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:45.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:45.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:45.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:46.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:46.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:46.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:46.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:47.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:47.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:47.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:47.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:48.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:48.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:48.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:48.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:49.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:49.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:49.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:49.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:50.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:50.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:50.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:50.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:51.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:51.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:51.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:51.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:52.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:52.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:52.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:52.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:53.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:53.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:53.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:53.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:54.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:54.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:54.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:54.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:55.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:55.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:55.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:55.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:56.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:56.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:56.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:56.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:57.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:57.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:57.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:57.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:58.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:58.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:58.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:58.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:59.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:11:59.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:11:59.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:11:59.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:00.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:00.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:00.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:00.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:01.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:01.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:01.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:01.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:02.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:02.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:02.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:02.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:03.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:03.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:03.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:03.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:04.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:04.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:04.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:04.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:05.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:05.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:05.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:05.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:06.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:06.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:06.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:06.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:07.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:07.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:07.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:07.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:08.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:08.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:08.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:08.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:09.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:09.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:09.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:09.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:10.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:10.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:10.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:10.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:11.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:11.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:11.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:11.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:12.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:12.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:12.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:12.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:13.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:13.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:13.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:13.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:14.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:14.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:14.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:14.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:15.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:15.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:15.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:15.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:16.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:16.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:16.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:16.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:17.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:17.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:17.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:17.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:18.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:18.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:18.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:18.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:19.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:19.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:19.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:19.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:20.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:20.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:20.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:20.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:21.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:21.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:21.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:21.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:22.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:22.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:22.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:22.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:23.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:23.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:23.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:23.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:24.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:24.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:24.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:24.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:25.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:25.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:25.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:25.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:26.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:26.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:26.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:26.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:27.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:27.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:27.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:27.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:28.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:28.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:28.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:28.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:29.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:29.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:29.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:29.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:30.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:30.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:30.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:30.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:31.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:31.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:31.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:31.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:32.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:32.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:32.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:32.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:33.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:33.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:33.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:33.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:34.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:34.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:34.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:34.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:35.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:35.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:35.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:35.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:36.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:36.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:36.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:36.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:37.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:37.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:37.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:37.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:38.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:38.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:38.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:38.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:39.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:39.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:39.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:39.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:40.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:40.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:40.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:40.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:41.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:41.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:41.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:41.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:42.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:42.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:42.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:42.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:43.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:43.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:43.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:43.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:44.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:44.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:44.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:44.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:45.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:45.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:45.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:45.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:46.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:46.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:46.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:46.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:47.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:47.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:47.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:47.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:48.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:48.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:48.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:48.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:49.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:49.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:49.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:49.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:50.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:50.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:50.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:50.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:51.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:51.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:51.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:51.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:52.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:52.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:52.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:52.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:53.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:53.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:53.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:53.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:54.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:54.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:54.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:54.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:55.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:55.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:55.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:55.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:56.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:56.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:56.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:56.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:57.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:57.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:57.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:57.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:58.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:58.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:58.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:58.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:59.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:12:59.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:12:59.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:12:59.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:00.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:00.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:00.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:00.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:01.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:01.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:01.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:01.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:02.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:02.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:02.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:02.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:03.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:03.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:03.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:03.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:04.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:04.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:04.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:04.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:05.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:05.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:05.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:05.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:06.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:06.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:06.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:06.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:07.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:07.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:07.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:07.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:08.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:08.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:08.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:08.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:09.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:09.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:09.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:09.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:10.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:10.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:10.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:10.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:11.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:11.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:11.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:11.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:12.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:12.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:12.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:12.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:13.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:13.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:13.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:13.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:14.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:14.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:14.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:14.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:15.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:15.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:15.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:15.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:16.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:16.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:16.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:16.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:17.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:17.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:17.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:17.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:18.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:18.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:18.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:18.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:19.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:19.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:19.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:19.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:20.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:20.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:20.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:20.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:21.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:21.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:21.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:21.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:22.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:22.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:22.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:22.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:23.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:23.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:23.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:23.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:24.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:24.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:24.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:24.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:25.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:25.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:25.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:25.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:26.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:26.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:26.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:26.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:27.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:27.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:27.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:27.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:28.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:28.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:28.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:28.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:29.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:29.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:29.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:29.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:30.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:30.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:30.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:30.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:31.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:31.198+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:31.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:31.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:32.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:32.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:32.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:32.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:33.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:33.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:33.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:33.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:34.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:34.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:34.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:34.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:35.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:35.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:35.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:35.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:36.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:36.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:36.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:36.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:37.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:37.158+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:37.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:37.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:38.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:38.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:38.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:38.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:39.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:39.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:39.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:39.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:40.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:40.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:40.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:40.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:41.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:41.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:41.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:41.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:42.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:42.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:42.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:42.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:43.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:43.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:43.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:43.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:44.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:44.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:44.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:44.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:45.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:45.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:45.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:45.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:46.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:46.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:46.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:46.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:47.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:47.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:47.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:47.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:48.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:48.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:48.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:48.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:49.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:49.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:49.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:49.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:50.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:50.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:50.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:50.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:51.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:51.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:51.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:51.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:52.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:52.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:52.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:52.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:53.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:53.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:53.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:53.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:54.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:54.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:54.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:54.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:55.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:55.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:55.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:55.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:56.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:56.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:56.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:56.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:57.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:57.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:57.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:57.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:58.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:58.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:58.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:58.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:59.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:13:59.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:13:59.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:13:59.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:00.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:00.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:00.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:00.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:01.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:01.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:01.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:01.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:02.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:02.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:02.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:02.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:03.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:03.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:03.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:03.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:04.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:04.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:04.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:04.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:05.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:05.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:05.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:05.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:06.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:06.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:06.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:06.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:07.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:07.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:07.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:07.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:08.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:08.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:08.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:08.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:09.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:09.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:09.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:09.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:10.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:10.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:10.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:10.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:11.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:11.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:11.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:11.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:12.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:12.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:12.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:12.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:13.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:13.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:13.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:13.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:14.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:14.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:14.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:14.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:15.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:15.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:15.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:15.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:16.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:16.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:16.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:16.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:17.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:17.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:17.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:17.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:18.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:18.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:18.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:18.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:19.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:19.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:19.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:19.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:20.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:20.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:20.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:20.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:21.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:21.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:21.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:21.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:22.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:22.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:22.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:22.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:23.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:23.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:23.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:23.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:24.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:24.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:24.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:24.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:25.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:25.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:25.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:25.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:26.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:26.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:26.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:26.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:27.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:27.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:27.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:27.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:28.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:28.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:28.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:28.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:29.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:29.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:29.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:29.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:30.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:30.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:30.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:30.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:31.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:31.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:31.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:31.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:32.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:32.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:32.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:32.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:33.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:33.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:33.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:33.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:34.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:34.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:34.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:34.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:35.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:35.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:35.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:35.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:36.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:36.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:36.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:36.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:37.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:37.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:37.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:37.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:38.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:38.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:38.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:39.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:39.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:39.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:39.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:40.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:40.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:40.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:40.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:41.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:41.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:41.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:41.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:42.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:42.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:42.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:42.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:43.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:43.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:43.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:43.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:44.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:44.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:44.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:44.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:45.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:45.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:45.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:45.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:46.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:46.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:46.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:46.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:47.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:47.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:47.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:47.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:48.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:48.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:48.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:48.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:49.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:49.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:49.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:49.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:50.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:50.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:50.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:50.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:51.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:51.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:51.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:51.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:52.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:52.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:52.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:52.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:53.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:53.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:53.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:53.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:54.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:54.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:54.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:54.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:55.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:55.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:55.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:55.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:56.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:56.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:56.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:56.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:57.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:57.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:57.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:57.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:58.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:58.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:58.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:58.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:59.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:14:59.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:14:59.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:14:59.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:00.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:00.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:00.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:00.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:01.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:01.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:01.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:01.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:01.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:01.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:02.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:02.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:03.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:03.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:03.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:03.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:04.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:04.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:04.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:04.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:05.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:05.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:05.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:05.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:06.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:06.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:06.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:06.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:07.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:07.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:07.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:07.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:08.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:08.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:08.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:08.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:09.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:09.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:09.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:09.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:10.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:10.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:10.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:10.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:11.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:11.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:11.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:11.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:12.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:12.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:12.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:12.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:13.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:13.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:13.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:13.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:14.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:14.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:14.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:14.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:15.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:15.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:15.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:15.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:16.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:16.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:16.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:16.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:17.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:17.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:17.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:17.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:18.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:18.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:18.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:18.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:19.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:19.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:19.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:19.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:20.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:20.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:20.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:20.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:21.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:21.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:21.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:21.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:22.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:22.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:22.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:22.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:23.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:23.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:23.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:23.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:24.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:24.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:24.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:24.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:25.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:25.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:25.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:25.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:26.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:26.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:26.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:26.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:27.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:27.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:27.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:27.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:28.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:28.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:28.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:28.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:29.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:29.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:29.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:29.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:30.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:30.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:30.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:30.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:31.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:31.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:31.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:31.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:32.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:32.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:32.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:32.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:33.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:33.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:33.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:33.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:34.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:34.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:34.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:34.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:35.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:35.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:35.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:35.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:36.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:36.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:36.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:36.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:37.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:37.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:37.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:37.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:38.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:38.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:38.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:38.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:39.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:39.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:39.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:39.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:40.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:40.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:40.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:40.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:41.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:41.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:41.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:41.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:42.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:42.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:42.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:42.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:43.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:43.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:43.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:43.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:44.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:44.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:44.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:44.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:45.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:45.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:45.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:45.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:46.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:46.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:46.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:46.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:47.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:47.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:47.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:47.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:48.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:48.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:48.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:48.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:49.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:49.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:49.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:49.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:50.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:50.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:50.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:50.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:51.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:51.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:51.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:51.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:52.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:52.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:52.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:52.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:53.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:53.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:53.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:53.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:54.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:54.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:54.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:54.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:55.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:55.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:55.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:55.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:56.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:56.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:56.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:56.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:57.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:57.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:57.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:57.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:58.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:58.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:58.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:58.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:59.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:15:59.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:15:59.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:15:59.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:00.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:00.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:00.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:00.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:01.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:01.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:01.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:01.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:02.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:02.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:02.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:02.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:03.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:03.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:03.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:03.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:04.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:04.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:04.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:04.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:05.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:05.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:05.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:05.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:06.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:06.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:06.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:06.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:07.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:07.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:07.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:07.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:08.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:08.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:08.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:08.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:09.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:09.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:09.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:09.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:10.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:10.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:10.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:10.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:11.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:11.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:11.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:11.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:12.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:12.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:12.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:12.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:13.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:13.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:13.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:13.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:14.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:14.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:14.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:14.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:15.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:15.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:15.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:15.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:16.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:16.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:16.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:16.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:17.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:17.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:17.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:17.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:18.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:18.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:18.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:18.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:19.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:19.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:19.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:19.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:20.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:20.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:20.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:20.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:21.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:21.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:21.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:21.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:22.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:22.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:22.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:22.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:23.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:23.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:23.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:23.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:24.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:24.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:24.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:24.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:25.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:25.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:25.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:25.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:26.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:26.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:26.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:26.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:27.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:27.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:27.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:27.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:28.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:28.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:28.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:28.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:29.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:29.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:29.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:29.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:30.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:30.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:30.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:30.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:31.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:31.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:31.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:31.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:32.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:32.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:32.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:32.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:33.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:33.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:33.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:33.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:34.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:34.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:34.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:34.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:35.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:35.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:35.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:35.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:36.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:36.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:36.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:36.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:37.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:37.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:37.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:37.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:38.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:38.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:38.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:38.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:39.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:39.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:39.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:39.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:40.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:40.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:40.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:40.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:41.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:41.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:41.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:41.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:42.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:42.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:42.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:42.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:43.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:43.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:43.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:43.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:44.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:44.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:44.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:44.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:45.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:45.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:45.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:45.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:46.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:46.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:46.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:46.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:47.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:47.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:47.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:47.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:48.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:48.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:48.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:48.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:49.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:49.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:49.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:49.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:50.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:50.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:50.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:50.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:51.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:51.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:51.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:51.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:52.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:52.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:52.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:52.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:53.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:53.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:53.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:53.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:54.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:54.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:54.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:54.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:55.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:55.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:55.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:55.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:56.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:56.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:56.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:56.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:57.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:57.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:57.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:57.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:58.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:58.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:58.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:58.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:59.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:16:59.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:16:59.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:16:59.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:00.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:00.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:00.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:00.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:01.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:01.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:01.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:01.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:02.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:02.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:02.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:02.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:03.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:03.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:03.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:03.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:04.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:04.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:04.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:04.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:05.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:05.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:05.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:05.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:06.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:06.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:06.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:06.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:07.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:07.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:07.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:07.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:08.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:08.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:08.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:08.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:09.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:09.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:09.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:09.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:10.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:10.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:10.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:10.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:11.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:11.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:11.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:11.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:12.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:12.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:12.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:12.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:13.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:13.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:13.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:13.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:14.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:14.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:14.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:14.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:15.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:15.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:15.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:15.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:16.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:16.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:16.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:16.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:17.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:17.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:17.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:17.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:18.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:18.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:18.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:18.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:19.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:19.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:19.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:19.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:20.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:20.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:20.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:20.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:21.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:21.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:21.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:21.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:22.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:22.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:22.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:22.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:23.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:23.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:23.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:23.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:24.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:24.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:24.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:24.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:25.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:25.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:25.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:25.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:26.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:26.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:26.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:26.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:27.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:27.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:27.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:27.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:28.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:28.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:28.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:28.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:29.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:29.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:29.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:29.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:30.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:30.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:30.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:30.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:31.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:31.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:31.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:31.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:32.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:32.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:32.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:32.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:33.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:33.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:33.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:33.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:34.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:34.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:34.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:34.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:35.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:35.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:35.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:35.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:36.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:36.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:36.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:36.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:37.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:37.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:37.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:37.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:38.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:38.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:38.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:38.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:39.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:39.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:39.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:40.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:40.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:40.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:40.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:41.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:41.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:41.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:41.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:42.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:42.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:42.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:42.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:43.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:43.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:43.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:43.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:44.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:44.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:44.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:44.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:45.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:45.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:45.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:45.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:46.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:46.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:46.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:46.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:47.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:47.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:47.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:47.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:48.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:48.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:48.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:48.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:49.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:49.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:49.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:49.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:50.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:50.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:50.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:50.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:51.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:51.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:51.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:51.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:52.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:52.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:52.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:52.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:53.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:53.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:53.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:53.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:54.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:54.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:54.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:54.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:55.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:55.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:55.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:55.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:56.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:56.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:56.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:56.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:57.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:57.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:57.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:57.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:58.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:58.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:58.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:58.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:59.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:17:59.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:17:59.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:17:59.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:00.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:00.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:00.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:00.968+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:01.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:01.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:01.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:01.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:02.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:02.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:03.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:03.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:03.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:03.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:03.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:03.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:04.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:04.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:04.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:04.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:05.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:05.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:05.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:05.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:06.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:06.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:06.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:06.980+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:07.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:07.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:07.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:07.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:08.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:08.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:08.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:08.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:09.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:09.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:10.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:10.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:10.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:10.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:11.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:11.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:11.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:11.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:12.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:12.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:12.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:12.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:13.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:13.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:13.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:13.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:14.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:14.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:14.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:14.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:14.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:14.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:15.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:15.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:15.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:15.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:16.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:16.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:16.928 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:16.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:17.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:17.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:17.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:17.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:18.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:18.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:18.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:18.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:19.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:19.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:19.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:19.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:20.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:20.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:20.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:20.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:21.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:21.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:21.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:21.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:22.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:22.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:22.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:22.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:23.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:23.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:23.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:23.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:24.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:24.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:24.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:24.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:25.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:25.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:25.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:25.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:26.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:26.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:26.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:26.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:27.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:27.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:28.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:28.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:28.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:28.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:29.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:29.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:29.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:29.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:30.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:30.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:30.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:30.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:31.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:31.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:31.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:31.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:32.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:32.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:32.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:32.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:33.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:33.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:33.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:33.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:34.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:34.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:34.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:34.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:35.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:35.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:35.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:35.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:36.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:36.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:36.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:36.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:37.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:37.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:37.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:37.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:38.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:38.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:38.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:38.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:39.155 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:39.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:39.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:39.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:40.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:40.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:40.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:40.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:41.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:41.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:41.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:41.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:42.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:42.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:42.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:42.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:43.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:43.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:43.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:43.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:44.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:44.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:44.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:44.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:45.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:45.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:45.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:45.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:46.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:46.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:46.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:46.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:47.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:47.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:47.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:47.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:48.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:48.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:48.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:48.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:49.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:49.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:49.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:49.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:50.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:50.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:50.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:50.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:50.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:50.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:51.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:51.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:51.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:51.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:52.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:52.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:52.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:52.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:53.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:53.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:53.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:53.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:54.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:54.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:54.903 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:54.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:55.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:55.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:55.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:55.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:56.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:56.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:56.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:56.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:57.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:57.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:57.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:57.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:58.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:58.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:58.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:58.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:59.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:18:59.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:18:59.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:18:59.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:00.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:00.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:00.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:00.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:01.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:01.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:01.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:01.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:02.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:02.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:02.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:02.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:03.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:03.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:03.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:03.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:04.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:04.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:04.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:04.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:05.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:05.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:05.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:05.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:06.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:06.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:06.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:06.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:07.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:07.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:08.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:08.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:08.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:08.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:08.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:08.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:09.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:09.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:09.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:09.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:10.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:10.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:10.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:10.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:11.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:11.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:11.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:11.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:12.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:12.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:12.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:12.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:13.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:13.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:14.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:14.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:14.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:14.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:14.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:14.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:15.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:15.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:15.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:15.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:16.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:16.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:16.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:16.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:17.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:17.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:17.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:17.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:18.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:18.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:18.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:18.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:19.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:19.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:19.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:19.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:20.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:20.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:20.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:20.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:21.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:21.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:22.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:21.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:22.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:22.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:22.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:22.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:23.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:23.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:24.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:24.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:24.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:24.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:24.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:24.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:25.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:25.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:25.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:25.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:26.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:26.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:26.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:26.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:27.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:27.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:27.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:27.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:28.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:28.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:28.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:28.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:29.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:29.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:30.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:30.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:30.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:30.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:30.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:30.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:31.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:31.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:31.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:31.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:32.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:32.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:32.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:32.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:33.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:33.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:33.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:33.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:34.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:34.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:34.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:34.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:35.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:35.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:35.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:35.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:36.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:36.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:36.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:36.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:37.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:37.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:38.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:38.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:38.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:38.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:38.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:38.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:39.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:39.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:39.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:39.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:40.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:40.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:40.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:40.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:41.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:41.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:41.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:41.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:42.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:42.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:42.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:42.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:43.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:43.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:43.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:43.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:44.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:44.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:44.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:44.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:45.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:45.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:45.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:45.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:46.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:46.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:46.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:46.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:47.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:47.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:47.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:47.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:48.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:48.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:48.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:48.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:49.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:49.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:50.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:50.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:50.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:50.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:50.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:50.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:51.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:51.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:51.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:51.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:52.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:52.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:53.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:52.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:53.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:53.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:54.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:53.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:54.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:54.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:54.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:54.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:55.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:55.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:55.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:55.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:56.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:56.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:56.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:56.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:57.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:57.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:57.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:57.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:58.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:58.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:58.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:58.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:59.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:19:59.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:19:59.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:19:59.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:00.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:00.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:00.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:00.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:01.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:01.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:01.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:01.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:02.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:02.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:02.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:02.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:03.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:03.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:03.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:03.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:04.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:04.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:04.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:04.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:05.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:05.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:05.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:05.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:06.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:06.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:06.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:06.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:07.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:07.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:07.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:07.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:08.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:08.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:08.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:08.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:09.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:09.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:09.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:09.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:10.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:10.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:10.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:10.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:11.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:11.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:11.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:11.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:12.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:12.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:12.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:12.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:13.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:13.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:13.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:13.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:14.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:14.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:14.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:14.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:15.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:15.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:15.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:15.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:16.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:16.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:16.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:16.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:17.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:17.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:17.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:17.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:18.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:18.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:18.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:18.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:19.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:19.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:19.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:19.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:20.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:20.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:20.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:20.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:21.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:21.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:22.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:22.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:22.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:22.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:23.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:23.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:23.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:23.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:23.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:23.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:24.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:24.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:24.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:24.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:25.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:25.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:25.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:25.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:26.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:26.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:27.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:27.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:27.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:27.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:28.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:28.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:28.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:28.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:29.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:29.000+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:29.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:29.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:30.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:30.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:30.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:30.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:31.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:31.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:31.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:31.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:32.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:32.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:32.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:32.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:33.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:33.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:33.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:33.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:34.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:34.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:34.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:34.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:35.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:35.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:35.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:35.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:36.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:36.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:36.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:36.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:37.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:37.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:37.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:37.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:38.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:38.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:38.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:38.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:39.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:39.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:39.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:39.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:40.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:40.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:40.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:40.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:41.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:41.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:41.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:41.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:42.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:42.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:42.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:42.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:43.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:43.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:43.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:43.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:44.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:44.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:44.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:44.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:45.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:45.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:45.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:45.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:46.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:46.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:46.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:46.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:47.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:47.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:47.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:47.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:48.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:48.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:48.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:48.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:49.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:49.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:49.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:49.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:50.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:50.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:50.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:50.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:51.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:51.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:51.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:51.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:52.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:52.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:52.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:52.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:53.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:53.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:53.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:53.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:54.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:54.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:54.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:54.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:55.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:55.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:55.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:55.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:56.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:56.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:56.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:56.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:57.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:57.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:57.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:57.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:58.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:58.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:58.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:58.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:59.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:20:59.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:20:59.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:20:59.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:00.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:00.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:00.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:00.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:01.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:01.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:01.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:01.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:02.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:02.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:02.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:02.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:03.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:03.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:03.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:03.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:04.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:04.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:04.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:04.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:05.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:05.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:05.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:05.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:06.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:06.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:06.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:06.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:07.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:07.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:07.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:07.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:08.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:08.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:08.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:08.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:09.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:09.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:09.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:09.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:10.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:10.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:10.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:10.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:11.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:11.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:11.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:11.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:12.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:12.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:12.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:12.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:13.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:13.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:13.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:13.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:14.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:14.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:14.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:14.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:15.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:15.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:15.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:15.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:16.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:16.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:16.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:16.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:17.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:17.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:17.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:17.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:18.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:18.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:18.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:18.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:19.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:19.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:19.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:19.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:20.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:20.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:20.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:20.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:21.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:21.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:21.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:21.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:22.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:22.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:22.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:22.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:23.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:23.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:23.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:23.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:24.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:24.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:24.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:24.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:25.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:25.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:25.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:25.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:26.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:26.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:26.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:26.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:27.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:27.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:27.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:27.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:28.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:28.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:28.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:28.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:29.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:29.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:29.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:29.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:30.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:30.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:30.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:30.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:31.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:31.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:31.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:31.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:32.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:32.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:32.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:32.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:33.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:33.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:33.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:33.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:34.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:34.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:34.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:34.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:35.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:35.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:35.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:35.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:36.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:36.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:36.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:36.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:37.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:37.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:37.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:37.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:38.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:38.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:38.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:38.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:39.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:39.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:39.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:39.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:40.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:40.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:40.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:40.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:41.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:41.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:41.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:41.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:42.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:42.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:42.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:42.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:43.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:43.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:43.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:43.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:44.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:44.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:44.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:44.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:45.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:45.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:45.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:45.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:46.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:46.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:46.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:46.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:47.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:47.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:47.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:47.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:48.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:48.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:48.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:48.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:49.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:49.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:49.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:49.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:50.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:50.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:50.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:50.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:51.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:51.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:51.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:51.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:52.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:52.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:52.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:52.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:53.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:53.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:53.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:53.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:54.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:54.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:54.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:54.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:55.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:55.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:56.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:56.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:56.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:56.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:57.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:57.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:57.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:57.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:58.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:58.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:58.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:58.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:59.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:21:59.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:21:59.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:21:59.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:00.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:00.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:00.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:00.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:01.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:01.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:01.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:01.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:02.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:02.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:02.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:02.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:03.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:03.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:03.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:03.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:04.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:04.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:04.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:04.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:05.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:05.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:05.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:05.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:06.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:06.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:06.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:06.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:07.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:07.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:07.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:07.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:08.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:08.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:08.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:08.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:09.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:09.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:09.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:09.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:10.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:10.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:10.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:10.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:11.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:11.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:11.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:11.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:12.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:12.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:12.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:12.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:13.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:13.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:13.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:13.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:14.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:14.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:14.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:14.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:15.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:15.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:15.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:15.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:16.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:16.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:16.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:16.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:17.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:17.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:17.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:17.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:18.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:18.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:18.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:18.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:19.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:19.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:19.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:19.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:20.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:20.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:20.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:20.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:21.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:21.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:21.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:21.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:22.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:22.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:22.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:22.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:23.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:23.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:23.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:23.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:24.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:24.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:24.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:24.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:25.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:25.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:25.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:25.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:26.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:26.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:26.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:26.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:27.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:27.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:27.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:27.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:28.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:28.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:28.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:28.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:29.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:29.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:29.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:29.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:30.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:30.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:30.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:30.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:31.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:31.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:31.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:31.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:32.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:32.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:32.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:32.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:33.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:33.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:33.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:33.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:34.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:34.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:34.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:34.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:35.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:35.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:35.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:35.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:36.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:36.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:36.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:36.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:37.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:37.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:37.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:37.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:38.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:38.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:38.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:38.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:39.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:39.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:39.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:39.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:40.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:40.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:40.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:40.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:41.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:41.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:41.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:41.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:42.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:42.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:42.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:42.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:43.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:43.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:43.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:43.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:44.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:44.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:44.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:44.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:45.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:45.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:45.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:45.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:46.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:46.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:46.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:46.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:47.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:47.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:47.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:47.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:48.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:48.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:48.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:48.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:49.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:49.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:49.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:49.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:50.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:50.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:50.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:50.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:51.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:51.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:51.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:51.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:52.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:52.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:52.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:52.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:53.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:53.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:53.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:53.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:54.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:54.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:54.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:54.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:55.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:55.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:55.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:55.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:56.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:56.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:56.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:56.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:57.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:57.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:57.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:57.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:58.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:58.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:58.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:58.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:59.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:22:59.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:22:59.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:22:59.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:00.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:00.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:00.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:00.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:01.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:01.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:01.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:01.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:02.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:02.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:02.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:02.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:03.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:03.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:03.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:03.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:04.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:04.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:04.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:04.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:05.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:05.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:05.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:05.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:06.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:06.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:06.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:06.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:07.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:07.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:07.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:07.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:08.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:08.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:08.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:08.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:09.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:09.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:09.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:09.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:10.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:10.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:10.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:10.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:11.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:11.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:11.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:11.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:12.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:12.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:12.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:12.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:13.128 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:13.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:13.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:13.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:14.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:14.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:14.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:14.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:15.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:15.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:15.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:15.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:16.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:16.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:16.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:16.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:17.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:17.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:17.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:17.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:18.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:18.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:18.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:18.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:19.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:19.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:19.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:19.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:20.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:20.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:20.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:20.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:21.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:21.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:21.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:21.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:22.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:22.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:22.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:22.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:23.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:23.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:23.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:23.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:24.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:24.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:24.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:24.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:25.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:25.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:25.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:25.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:26.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:26.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:26.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:26.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:27.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:27.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:27.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:27.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:28.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:28.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:28.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:28.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:29.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:29.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:29.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:29.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:30.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:30.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:30.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:30.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:31.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:31.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:31.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:31.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:32.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:32.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:32.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:32.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:33.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:33.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:33.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:33.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:34.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:34.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:34.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:34.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:35.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:35.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:35.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:35.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:36.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:36.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:36.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:36.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:37.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:37.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:37.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:37.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:38.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:38.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:38.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:38.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:39.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:39.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:39.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:39.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:40.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:40.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:40.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:40.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:41.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:41.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:41.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:41.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:42.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:42.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:42.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:42.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:43.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:43.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:43.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:43.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:44.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:44.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:44.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:44.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:45.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:45.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:45.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:45.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:46.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:46.144+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:46.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:46.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:47.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:47.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:47.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:47.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:48.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:48.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:48.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:48.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:49.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:49.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:49.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:49.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:50.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:50.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:50.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:50.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:51.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:51.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:51.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:51.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:52.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:52.095+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:52.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:52.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:53.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:53.103+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:53.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:53.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:54.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:54.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:54.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:54.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:55.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:55.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:55.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:55.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:56.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:56.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:56.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:56.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:57.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:57.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:57.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:57.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:58.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:58.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:58.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:58.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:59.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:23:59.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:23:59.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:23:59.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:00.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:00.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:00.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:00.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:01.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:01.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:01.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:01.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:02.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:02.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:02.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:02.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:03.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:03.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:03.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:03.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:04.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:04.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:04.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:04.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:05.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:05.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:05.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:05.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:06.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:06.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:06.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:06.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:07.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:07.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:07.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:07.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:08.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:08.079+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:08.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:08.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:09.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:09.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:09.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:09.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:10.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:10.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:10.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:10.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:11.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:11.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:11.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:11.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:12.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:12.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:12.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:12.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:13.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:13.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:13.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:13.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:14.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:14.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:14.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:14.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:15.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:15.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:15.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:15.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:16.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:16.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:16.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:16.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:17.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:17.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:17.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:17.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:18.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:18.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:18.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:18.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:19.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:19.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:19.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:19.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:20.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:20.147+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:20.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:20.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:21.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:21.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:21.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:21.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:22.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:22.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:22.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:22.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:23.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:23.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:23.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:23.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:24.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:24.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:24.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:24.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:25.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:25.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:25.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:25.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:26.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:26.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:26.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:26.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:27.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:27.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:27.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:27.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:28.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:28.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:28.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:28.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:29.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:29.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:29.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:29.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:30.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:30.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:30.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:30.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:31.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:31.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:31.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:31.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:32.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:32.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:32.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:32.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:33.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:33.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:33.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:33.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:34.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:34.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:34.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:34.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:35.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:35.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:35.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:35.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:36.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:36.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:36.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:36.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:37.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:37.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:37.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:37.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:38.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:38.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:38.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:38.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:39.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:39.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:39.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:39.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:40.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:40.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:40.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:40.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:41.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:41.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:41.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:41.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:42.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:42.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:42.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:42.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:43.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:43.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:43.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:43.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:44.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:44.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:44.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:44.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:45.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:45.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:45.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:45.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:46.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:46.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:46.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:46.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:47.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:47.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:47.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:47.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:48.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:48.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:48.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:48.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:49.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:49.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:49.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:49.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:50.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:50.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:50.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:50.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:51.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:51.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:51.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:51.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:52.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:52.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:52.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:52.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:53.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:53.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:53.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:53.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:54.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:54.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:54.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:54.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:55.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:55.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:55.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:55.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:56.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:56.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:56.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:56.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:57.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:57.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:57.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:57.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:57.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:57.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:58.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:58.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:58.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:58.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:59.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:24:59.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:24:59.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:24:59.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:00.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:00.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:00.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:00.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:01.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:01.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:02.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:02.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:02.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:02.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:02.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:02.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:03.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:03.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:03.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:03.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:04.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:04.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:05.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:05.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:05.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:05.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:06.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:06.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:06.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:06.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:07.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:07.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:07.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:07.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:08.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:08.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:08.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:08.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:09.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:09.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:09.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:09.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:10.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:10.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:10.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:10.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:11.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:11.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:11.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:11.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:12.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:12.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:12.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:12.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:12.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:12.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:13.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:13.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:14.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:13.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:14.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:14.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:14.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:14.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:15.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:15.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:15.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:15.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:16.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:16.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:16.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:16.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:17.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:17.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:17.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:17.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:18.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:18.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:18.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:18.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:19.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:19.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:19.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:19.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:20.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:20.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:20.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:20.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:21.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:21.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:21.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:21.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:22.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:22.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:22.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:22.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:23.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:23.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:24.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:24.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:24.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:24.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:25.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:25.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:25.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:25.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:26.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:26.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:26.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:26.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:27.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:27.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:27.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:27.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:28.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:28.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:28.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:28.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:29.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:29.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:29.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:29.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:30.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:30.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:30.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:30.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:31.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:31.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:31.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:31.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:32.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:32.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:32.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:32.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:33.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:33.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:33.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:33.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:34.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:34.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:34.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:34.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:35.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:35.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:35.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:35.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:36.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:36.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:36.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:36.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:37.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:37.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:37.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:37.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:38.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:38.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:38.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:38.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:39.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:39.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:39.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:39.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:40.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:40.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:40.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:40.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:41.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:41.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:41.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:41.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:42.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:42.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:42.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:42.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:43.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:43.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:43.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:43.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:44.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:44.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:44.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:44.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:45.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:45.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:45.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:45.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:46.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:46.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:46.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:46.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:47.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:47.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:47.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:47.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:48.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:48.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:48.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:48.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:49.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:49.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:49.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:49.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:50.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:50.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:50.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:50.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:51.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:51.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:51.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:51.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:52.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:52.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:52.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:52.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:53.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:53.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:53.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:53.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:54.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:54.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:54.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:54.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:55.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:55.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:55.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:55.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:56.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:56.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:56.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:56.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:57.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:57.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:57.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:57.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:58.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:58.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:58.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:58.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:59.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:25:59.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:25:59.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:25:59.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:00.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:00.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:00.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:00.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:01.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:01.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:01.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:01.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:02.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:02.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:02.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:02.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:03.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:03.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:03.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:03.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:04.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:04.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:04.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:04.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:05.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:05.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:05.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:05.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:06.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:06.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:06.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:06.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:07.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:07.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:07.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:07.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:08.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:08.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:08.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:08.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:09.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:09.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:09.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:09.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:10.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:10.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:10.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:10.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:11.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:11.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:11.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:11.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:12.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:12.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:12.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:12.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:13.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:13.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:13.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:13.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:14.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:14.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:14.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:14.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:15.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:15.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:15.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:15.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:16.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:16.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:16.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:16.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:17.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:17.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:17.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:17.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:18.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:18.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:18.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:18.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:19.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:19.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:19.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:19.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:20.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:20.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:20.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:20.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:20.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:20.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:21.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:21.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:21.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:21.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:22.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:22.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:23.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:23.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:23.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:23.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:24.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:24.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:24.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:24.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:25.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:25.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:25.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:25.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:26.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:26.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:26.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:27.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:27.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:27.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:27.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:28.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:28.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:28.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:28.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:29.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:29.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:29.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:29.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:30.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:30.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:30.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:30.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:31.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:31.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:31.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:31.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:32.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:32.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:32.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:32.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:33.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:33.072+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:33.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:33.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:34.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:34.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:34.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:34.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:35.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:35.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:35.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:35.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:36.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:36.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:36.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:36.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:37.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:37.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:37.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:37.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:38.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:38.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:38.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:38.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:39.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:39.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:39.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:39.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:40.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:40.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:40.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:40.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:41.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:41.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:41.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:41.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:42.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:42.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:42.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:42.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:43.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:43.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:43.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:43.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:44.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:44.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:44.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:44.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:45.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:45.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:45.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:45.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:46.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:46.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:46.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:46.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:47.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:47.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:47.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:47.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:48.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:48.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:48.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:48.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:49.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:49.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:49.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:49.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:50.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:50.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:50.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:50.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:51.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:51.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:51.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:51.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:52.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:52.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:52.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:52.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:53.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:53.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:53.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:53.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:54.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:54.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:54.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:54.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:55.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:55.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:55.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:55.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:56.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:56.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:56.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:56.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:57.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:57.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:57.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:57.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:58.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:58.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:58.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:58.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:59.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:26:59.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:26:59.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:26:59.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:00.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:00.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:00.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:00.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:01.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:01.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:01.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:01.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:02.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:02.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:02.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:02.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:03.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:03.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:03.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:03.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:04.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:04.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:04.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:04.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:05.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:05.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:05.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:05.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:06.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:06.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:06.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:06.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:07.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:07.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:07.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:07.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:08.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:08.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:08.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:08.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:09.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:09.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:09.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:09.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:10.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:10.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:10.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:10.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:11.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:11.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:11.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:11.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:12.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:12.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:12.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:12.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:13.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:13.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:13.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:13.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:14.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:14.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:14.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:14.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:15.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:15.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:15.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:15.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:16.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:16.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:16.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:16.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:17.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:17.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:17.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:17.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:18.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:18.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:18.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:18.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:19.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:19.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:19.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:19.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:20.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:20.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:20.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:20.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:21.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:21.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:21.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:21.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:22.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:22.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:22.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:22.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:23.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:23.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:23.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:23.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:24.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:24.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:24.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:24.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:25.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:25.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:25.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:25.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:26.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:26.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:26.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:26.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:27.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:27.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:27.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:27.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:28.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:28.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:28.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:28.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:29.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:29.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:29.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:29.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:30.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:30.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:30.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:30.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:31.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:31.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:31.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:31.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:32.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:32.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:32.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:32.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:33.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:33.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:33.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:33.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:34.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:34.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:34.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:34.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:35.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:35.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:35.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:35.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:36.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:36.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:36.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:36.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:37.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:37.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:37.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:37.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:38.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:38.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:38.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:38.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:39.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:39.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:39.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:39.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:40.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:40.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:40.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:40.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:41.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:41.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:41.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:41.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:42.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:42.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:42.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:42.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:43.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:43.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:43.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:43.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:44.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:44.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:44.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:44.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:45.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:45.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:45.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:45.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:46.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:46.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:46.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:46.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:47.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:47.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:47.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:47.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:48.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:48.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:48.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:48.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:49.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:49.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:49.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:49.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:50.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:50.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:50.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:50.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:51.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:51.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:51.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:51.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:52.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:52.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:52.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:52.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:53.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:53.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:53.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:53.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:54.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:54.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:54.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:54.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:55.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:55.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:55.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:55.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:56.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:56.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:56.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:56.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:57.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:57.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:57.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:57.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:58.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:58.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:58.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:58.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:59.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:27:59.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:27:59.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:27:59.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:00.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:00.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:00.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:00.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:01.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:01.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:01.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:01.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:02.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:02.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:02.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:02.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:03.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:03.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:03.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:03.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:04.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:04.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:04.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:04.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:05.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:05.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:05.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:05.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:06.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:06.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:06.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:06.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:07.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:07.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:07.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:07.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:08.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:08.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:08.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:08.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:09.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:09.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:09.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:09.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:10.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:10.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:10.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:10.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:11.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:11.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:11.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:11.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:12.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:12.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:12.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:12.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:13.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:13.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:13.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:13.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:14.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:14.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:14.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:14.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:15.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:15.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:15.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:15.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:16.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:16.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:16.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:16.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:17.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:17.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:17.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:17.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:18.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:18.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:18.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:18.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:19.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:19.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:19.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:19.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:20.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:20.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:20.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:20.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:21.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:21.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:21.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:21.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:22.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:22.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:22.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:22.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:23.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:23.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:23.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:23.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:24.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:24.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:24.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:24.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:25.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:25.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:25.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:25.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:26.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:26.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:26.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:26.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:27.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:27.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:27.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:27.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:28.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:28.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:28.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:28.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:29.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:29.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:29.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:29.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:30.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:30.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:30.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:30.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:31.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:31.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:31.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:31.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:32.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:32.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:32.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:32.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:33.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:33.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:33.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:33.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:34.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:34.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:34.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:34.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:35.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:35.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:35.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:35.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:36.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:36.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:36.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:36.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:37.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:37.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:37.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:37.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:38.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:38.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:38.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:38.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:39.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:39.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:39.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:39.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:40.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:40.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:40.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:40.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:41.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:41.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:41.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:41.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:42.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:42.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:42.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:42.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:43.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:43.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:43.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:43.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:44.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:44.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:44.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:44.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:45.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:45.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:45.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:45.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:46.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:46.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:46.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:46.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:47.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:47.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:47.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:47.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:48.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:48.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:48.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:48.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:49.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:49.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:49.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:49.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:50.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:50.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:50.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:50.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:51.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:51.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:51.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:51.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:52.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:52.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:52.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:52.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:53.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:53.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:53.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:53.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:54.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:54.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:54.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:54.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:55.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:55.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:55.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:55.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:56.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:56.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:56.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:56.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:57.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:57.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:57.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:57.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:58.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:58.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:58.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:58.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:59.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:28:59.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:28:59.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:28:59.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:00.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:00.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:00.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:00.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:01.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:01.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:01.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:01.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:02.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:02.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:02.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:02.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:03.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:03.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:03.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:03.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:04.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:04.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:04.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:04.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:05.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:05.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:05.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:05.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:06.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:06.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:06.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:06.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:07.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:07.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:07.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:07.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:08.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:08.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:08.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:08.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:09.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:09.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:09.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:09.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:10.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:10.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:10.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:10.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:11.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:11.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:11.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:11.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:12.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:12.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:12.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:12.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:13.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:13.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:13.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:13.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:14.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:14.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:14.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:14.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:15.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:15.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:15.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:15.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:16.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:16.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:16.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:16.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:17.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:17.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:17.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:17.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:18.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:18.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:18.630 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:18.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:19.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:19.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:19.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:19.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:20.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:20.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:20.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:20.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:21.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:21.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:21.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:21.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:22.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:22.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:22.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:22.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:23.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:23.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:23.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:23.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:24.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:24.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:24.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:24.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:25.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:25.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:25.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:25.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:26.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:26.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:26.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:26.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:27.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:27.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:27.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:27.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:28.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:28.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:28.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:28.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:29.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:29.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:29.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:29.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:30.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:30.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:30.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:30.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:31.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:31.268+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:31.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:31.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:32.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:32.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:32.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:32.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:33.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:33.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:33.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:33.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:34.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:34.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:34.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:34.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:35.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:35.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:35.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:35.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:36.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:36.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:36.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:36.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:37.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:37.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:37.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:37.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:38.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:38.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:38.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:38.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:39.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:39.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:39.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:39.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:40.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:40.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:40.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:40.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:41.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:41.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:41.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:41.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:42.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:42.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:42.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:42.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:43.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:43.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:43.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:43.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:44.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:44.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:44.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:44.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:45.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:45.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:45.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:45.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:46.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:46.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:46.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:46.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:47.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:47.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:47.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:47.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:48.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:48.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:48.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:48.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:49.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:49.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:49.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:49.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:50.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:50.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:50.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:50.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:51.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:51.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:51.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:51.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:52.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:52.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:52.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:52.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:53.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:53.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:53.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:53.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:54.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:54.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:54.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:54.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:55.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:55.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:55.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:55.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:56.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:56.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:56.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:56.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:57.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:57.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:57.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:57.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:58.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:58.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:58.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:58.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:59.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:29:59.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:29:59.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:29:59.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:00.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:00.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:00.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:00.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:01.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:01.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:01.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:01.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:02.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:02.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:02.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:02.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:03.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:03.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:03.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:03.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:04.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:04.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:04.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:04.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:05.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:05.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:05.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:05.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:06.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:06.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:06.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:06.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:07.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:07.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:07.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:07.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:08.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:08.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:08.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:08.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:09.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:09.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:09.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:09.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:10.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:10.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:10.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:10.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:11.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:11.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:11.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:11.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:12.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:12.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:12.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:12.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:13.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:13.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:13.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:13.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:14.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:14.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:14.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:14.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:15.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:15.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:15.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:15.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:16.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:16.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:16.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:16.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:17.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:17.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:17.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:17.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:18.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:18.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:18.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:18.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:19.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:19.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:19.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:19.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:20.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:20.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:20.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:20.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:21.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:21.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:22.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:22.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:22.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:22.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:22.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:22.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:23.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:23.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:23.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:23.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:24.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:24.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:24.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:24.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:25.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:25.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:25.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:25.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:26.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:26.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:26.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:26.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:27.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:27.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:27.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:27.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:28.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:28.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:29.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:29.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:29.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:29.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:30.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:29.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:30.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:30.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:30.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:30.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:31.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:31.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:31.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:31.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:32.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:32.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:32.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:32.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:33.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:33.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:33.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:33.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:34.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:34.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:34.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:34.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:35.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:35.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:35.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:35.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:36.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:36.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:36.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:36.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:37.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:37.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:37.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:37.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:38.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:38.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:38.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:38.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:39.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:39.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:39.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:39.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:40.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:40.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:40.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:40.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:41.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:41.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:41.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:41.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:42.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:42.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:42.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:42.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:43.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:43.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:43.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:43.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:44.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:44.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:44.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:44.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:45.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:45.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:45.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:45.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:46.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:46.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:46.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:46.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:47.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:47.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:47.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:47.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:48.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:48.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:48.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:48.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:49.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:49.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:49.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:49.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:50.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:50.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:50.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:50.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:51.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:51.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:51.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:51.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:52.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:52.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:52.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:52.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:53.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:53.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:53.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:53.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:54.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:54.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:54.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:54.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:55.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:55.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:55.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:55.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:56.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:56.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:56.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:56.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:57.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:57.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:57.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:57.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:58.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:58.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:58.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:58.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:59.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:30:59.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:30:59.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:30:59.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:00.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:00.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:00.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:00.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:01.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:01.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:01.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:01.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:02.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:02.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:02.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:02.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:03.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:03.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:03.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:03.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:04.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:04.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:04.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:04.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:05.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:05.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:05.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:05.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:06.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:06.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:06.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:06.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:07.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:07.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:07.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:07.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:08.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:08.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:08.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:08.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:09.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:09.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:09.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:09.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:10.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:10.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:10.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:10.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:11.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:11.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:11.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:11.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:12.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:12.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:12.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:12.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:13.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:13.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:13.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:13.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:14.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:14.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:14.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:14.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:15.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:15.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:15.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:15.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:16.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:16.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:16.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:16.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:17.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:17.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:17.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:17.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:18.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:18.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:18.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:18.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:19.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:19.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:19.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:19.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:20.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:20.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:20.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:20.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:21.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:21.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:21.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:21.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:22.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:22.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:22.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:22.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:23.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:23.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:23.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:23.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:24.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:24.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:24.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:24.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:25.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:25.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:25.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:25.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:26.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:26.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:26.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:26.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:27.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:27.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:27.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:27.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:28.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:28.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:28.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:28.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:29.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:29.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:29.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:29.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:30.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:30.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:30.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:30.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:31.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:31.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:31.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:31.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:32.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:32.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:32.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:32.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:33.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:33.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:33.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:33.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:34.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:34.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:34.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:34.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:35.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:35.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:35.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:35.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:36.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:36.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:36.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:36.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:37.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:37.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:37.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:37.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:38.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:38.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:38.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:38.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:39.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:39.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:39.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:39.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:40.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:40.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:40.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:40.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:41.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:41.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:41.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:41.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:42.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:42.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:42.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:42.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:43.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:43.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:43.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:43.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:44.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:44.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:44.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:44.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:45.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:45.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:45.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:45.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:46.600 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:46.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:46.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:46.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:47.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:47.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:47.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:47.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:48.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:48.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:48.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:48.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:49.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:49.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:49.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:49.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:50.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:50.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:50.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:50.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:51.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:51.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:51.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:51.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:52.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:52.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:52.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:52.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:53.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:53.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:53.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:53.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:54.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:54.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:54.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:54.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:55.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:55.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:55.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:55.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:56.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:56.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:56.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:56.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:57.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:57.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:57.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:57.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:58.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:58.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:58.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:58.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:59.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:31:59.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:31:59.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:31:59.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:00.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:00.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:00.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:00.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:01.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:01.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:01.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:01.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:02.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:02.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:02.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:02.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:03.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:03.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:03.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:03.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:04.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:04.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:04.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:04.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:05.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:05.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:05.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:05.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:06.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:06.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:06.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:06.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:07.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:07.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:07.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:07.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:08.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:08.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:08.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:08.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:09.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:09.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:09.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:09.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:10.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:10.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:10.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:10.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:11.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:11.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:11.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:11.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:12.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:12.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:12.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:12.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:13.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:13.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:13.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:13.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:14.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:14.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:14.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:14.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:15.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:15.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:15.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:15.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:16.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:16.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:16.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:16.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:17.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:17.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:17.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:17.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:18.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:18.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:18.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:18.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:19.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:19.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:19.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:19.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:20.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:20.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:20.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:20.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:21.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:21.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:21.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:21.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:22.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:22.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:22.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:22.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:23.392 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:23.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:23.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:23.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:24.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:24.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:24.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:24.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:25.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:25.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:25.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:25.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:26.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:26.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:26.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:26.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:27.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:27.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:27.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:27.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:28.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:28.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:28.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:28.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:29.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:29.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:29.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:29.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:30.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:30.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:30.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:30.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:31.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:31.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:31.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:31.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:32.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:32.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:32.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:32.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:33.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:33.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:33.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:33.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:34.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:34.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:34.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:34.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:35.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:35.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:35.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:35.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:36.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:36.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:36.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:36.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:37.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:37.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:37.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:37.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:38.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:38.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:38.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:38.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:39.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:39.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:39.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:39.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:40.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:40.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:40.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:40.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:41.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:41.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:41.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:41.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:42.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:42.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:42.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:42.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:43.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:43.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:43.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:43.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:44.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:44.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:44.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:44.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:45.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:45.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:45.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:45.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:46.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:46.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:46.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:46.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:47.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:47.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:47.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:47.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:48.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:48.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:48.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:48.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:49.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:49.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:49.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:49.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:50.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:50.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:50.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:50.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:51.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:51.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:51.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:51.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:52.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:52.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:52.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:52.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:53.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:53.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:53.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:53.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:54.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:54.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:54.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:54.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:55.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:55.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:55.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:55.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:56.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:56.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:56.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:56.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:57.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:57.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:57.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:57.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:58.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:58.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:59.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:32:58.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:32:59.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:32:59.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:00.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:00.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:00.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:00.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:01.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:01.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:01.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:01.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:02.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:02.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:02.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:02.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:03.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:03.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:03.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:03.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:04.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:04.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:04.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:04.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:05.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:05.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:05.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:05.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:06.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:06.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:06.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:06.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:06.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:06.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:07.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:07.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:07.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:07.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:08.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:08.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:09.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:09.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:09.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:09.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:10.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:10.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:10.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:10.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:11.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:10.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:11.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:11.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:12.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:12.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:12.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:12.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:13.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:13.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:13.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:13.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:14.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:14.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:14.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:14.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:15.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:15.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:15.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:15.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:16.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:16.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:16.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:16.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:17.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:17.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:17.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:17.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:18.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:18.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:18.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:18.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:19.042 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:19.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:19.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:19.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:20.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:20.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:20.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:20.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:21.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:21.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:21.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:21.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:22.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:22.138+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:22.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:22.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:23.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:23.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:23.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:23.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:24.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:24.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:24.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:24.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:25.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:25.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:25.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:25.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:26.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:26.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:26.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:26.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:27.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:27.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:27.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:27.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:28.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:28.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:28.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:28.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:29.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:29.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:29.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:29.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:30.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:30.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:30.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:30.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:31.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:31.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:31.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:31.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:32.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:32.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:32.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:32.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:33.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:33.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:33.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:33.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:34.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:34.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:34.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:34.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:35.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:35.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:35.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:35.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:36.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:36.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:36.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:36.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:37.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:37.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:37.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:37.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:38.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:38.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:38.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:38.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:39.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:39.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:39.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:39.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:40.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:40.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:40.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:40.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:41.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:41.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:41.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:41.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:42.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:42.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:42.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:42.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:43.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:43.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:43.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:43.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:44.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:44.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:44.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:44.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:45.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:45.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:45.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:45.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:46.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:46.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:46.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:46.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:47.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:47.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:47.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:47.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:48.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:48.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:48.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:48.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:49.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:49.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:49.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:49.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:50.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:50.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:50.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:50.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:51.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:51.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:51.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:51.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:52.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:52.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:52.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:52.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:53.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:53.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:53.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:53.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:54.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:54.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:54.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:54.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:55.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:55.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:55.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:55.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:56.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:56.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:56.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:56.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:57.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:57.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:57.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:57.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:58.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:58.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:58.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:58.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:59.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:33:59.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:33:59.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:33:59.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:00.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:00.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:00.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:00.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:01.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:01.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:01.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:01.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:02.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:02.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:02.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:02.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:03.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:03.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:03.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:03.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:04.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:04.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:04.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:04.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:05.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:05.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:05.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:05.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:06.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:06.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:06.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:06.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:07.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:07.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:07.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:07.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:08.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:08.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:08.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:08.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:09.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:09.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:09.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:09.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:10.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:10.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:10.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:10.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:11.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:11.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:11.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:11.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:12.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:12.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:12.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:12.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:13.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:13.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:13.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:13.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:14.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:14.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:14.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:14.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:15.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:15.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:15.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:15.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:16.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:16.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:16.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:16.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:17.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:17.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:17.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:17.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:18.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:18.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:18.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:18.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:19.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:19.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:19.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:19.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:20.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:20.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:20.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:20.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:21.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:21.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:21.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:21.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:22.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:22.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:22.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:22.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:23.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:23.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:23.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:23.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:24.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:24.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:24.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:24.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:25.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:25.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:25.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:25.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:26.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:26.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:26.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:26.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:27.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:27.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:27.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:27.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:28.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:28.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:28.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:28.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:29.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:29.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:29.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:29.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:30.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:30.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:30.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:30.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:31.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:31.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:31.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:31.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:32.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:32.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:32.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:32.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:33.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:33.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:33.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:33.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:34.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:34.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:34.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:34.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:35.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:35.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:35.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:35.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:36.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:36.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:36.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:36.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:37.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:37.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:37.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:37.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:38.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:38.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:38.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:38.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:39.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:39.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:39.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:39.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:40.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:40.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:40.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:40.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:41.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:41.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:41.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:41.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:42.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:42.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:42.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:42.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:43.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:43.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:43.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:43.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:44.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:44.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:44.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:44.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:45.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:45.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:45.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:45.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:46.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:46.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:46.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:46.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:47.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:47.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:47.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:47.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:48.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:48.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:48.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:48.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:49.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:49.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:49.664 INFO:tasks.workunit.client.0.smithi163.stderr:2023-05-20T06:34:49.656+0000 7f5fc3e68700 0 -- 172.21.15.163:0/3549511776 >> [v2:172.21.15.163:6816/29216,v1:172.21.15.163:6817/29216] conn(0x7f5fa4056020 msgr2=0x7f5fa40dd160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-05-20T06:34:49.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:49.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:50.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:50.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:50.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:50.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:51.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:51.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:51.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:51.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:52.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:52.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:52.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:52.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:53.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:53.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:53.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:53.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:54.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:54.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:54.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:54.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:55.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:55.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:55.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:55.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:56.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:56.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:56.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:56.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:57.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:57.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:57.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:57.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:58.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:58.248+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:58.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:58.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:59.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:34:59.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:34:59.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:34:59.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:00.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:00.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:00.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:00.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:01.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:01.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:01.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:01.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:02.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:02.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:02.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:02.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:03.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:03.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:03.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:03.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:04.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:04.264+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:04.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:04.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:05.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:05.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:05.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:05.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:06.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:06.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:06.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:06.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:07.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:07.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:07.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:07.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:08.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:08.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:08.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:08.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:09.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:09.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:09.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:09.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:10.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:10.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:10.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:10.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:11.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:11.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:11.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:11.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:12.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:12.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:12.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:12.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:13.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:13.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:13.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:13.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:14.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:14.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:14.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:14.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:15.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:15.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:15.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:15.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:16.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:16.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:16.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:16.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:17.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:17.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:17.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:17.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:18.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:18.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:18.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:18.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:19.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:19.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:19.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:19.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:20.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:20.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:20.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:20.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:21.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:21.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:21.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:21.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:22.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:22.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:22.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:22.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:23.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:23.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:23.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:23.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:24.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:24.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:24.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:24.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:25.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:25.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:25.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:25.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:26.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:26.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:26.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:26.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:27.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:27.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:27.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:27.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:28.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:28.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:28.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:28.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:29.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:29.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:29.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:29.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:30.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:30.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:30.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:30.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:31.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:31.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:31.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:31.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:32.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:32.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:32.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:32.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:33.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:33.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:33.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:33.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:34.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:34.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:34.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:34.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:35.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:35.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:35.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:35.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:36.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:36.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:36.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:36.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:37.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:37.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:37.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:37.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:38.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:38.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:38.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:38.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:39.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:39.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:39.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:39.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:40.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:40.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:40.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:40.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:41.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:41.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:41.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:41.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:42.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:42.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:42.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:42.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:43.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:43.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:43.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:43.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:44.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:44.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:44.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:44.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:45.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:45.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:45.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:45.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:46.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:46.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:46.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:46.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:47.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:47.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:47.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:47.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:48.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:48.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:48.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:48.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:49.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:49.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:49.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:49.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:50.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:50.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:50.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:50.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:51.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:51.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:51.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:51.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:52.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:52.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:52.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:52.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:53.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:53.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:53.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:53.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:54.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:54.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:54.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:54.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:55.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:55.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:55.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:55.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:56.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:56.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:56.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:56.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:57.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:57.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:57.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:57.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:58.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:58.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:58.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:58.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:59.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:35:59.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:35:59.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:35:59.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:00.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:00.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:00.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:00.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:01.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:01.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:01.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:01.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:02.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:02.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:02.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:02.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:03.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:03.598+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:03.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:03.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:04.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:04.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:04.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:04.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:05.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:05.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:05.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:05.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:06.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:06.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:06.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:06.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:07.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:07.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:07.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:07.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:08.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:08.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:08.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:08.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:09.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:09.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:09.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:09.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:10.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:10.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:10.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:10.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:11.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:11.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:11.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:11.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:12.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:12.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:12.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:12.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:13.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:13.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:13.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:13.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:14.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:14.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:14.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:14.822+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:15.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:15.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:15.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:15.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:16.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:16.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:16.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:16.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:17.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:17.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:17.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:17.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:18.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:18.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:18.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:18.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:19.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:19.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:19.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:19.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:20.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:20.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:20.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:20.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:21.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:21.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:21.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:21.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:22.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:22.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:22.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:22.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:23.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:23.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:23.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:23.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:24.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:24.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:24.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:24.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:25.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:25.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:25.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:25.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:26.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:26.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:26.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:26.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:27.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:27.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:27.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:27.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:28.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:28.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:28.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:28.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:29.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:29.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:29.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:29.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:30.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:30.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:30.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:30.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:31.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:31.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:31.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:31.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:32.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:32.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:32.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:32.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:33.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:33.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:33.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:33.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:34.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:34.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:34.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:34.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:35.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:35.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:35.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:35.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:36.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:36.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:36.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:36.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:37.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:37.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:37.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:37.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:38.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:38.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:38.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:38.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:39.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:39.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:39.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:39.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:40.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:40.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:40.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:40.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:41.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:41.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:41.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:41.721+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:42.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:42.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:42.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:42.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:43.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:43.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:43.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:43.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:44.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:44.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:44.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:44.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:45.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:45.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:45.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:45.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:46.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:46.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:46.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:46.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:47.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:47.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:47.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:47.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:48.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:48.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:48.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:48.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:49.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:49.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:49.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:49.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:50.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:50.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:50.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:50.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:51.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:51.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:51.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:51.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:52.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:52.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:52.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:52.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:53.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:53.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:53.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:53.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:54.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:54.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:54.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:54.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:55.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:55.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:55.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:55.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:56.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:56.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:56.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:56.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:57.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:57.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:57.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:57.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:58.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:58.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:58.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:58.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:59.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:36:59.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:36:59.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:36:59.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:00.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:00.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:00.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:00.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:01.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:01.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:01.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:01.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:02.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:02.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:02.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:02.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:03.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:03.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:03.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:03.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:04.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:04.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:04.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:04.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:05.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:05.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:05.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:05.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:06.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:06.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:06.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:06.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:07.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:07.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:07.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:07.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:08.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:08.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:08.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:08.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:09.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:09.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:09.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:09.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:10.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:10.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:10.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:10.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:11.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:11.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:11.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:11.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:12.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:12.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:12.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:12.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:13.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:13.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:13.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:13.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:14.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:14.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:14.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:14.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:15.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:15.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:15.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:15.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:16.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:16.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:16.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:16.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:17.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:17.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:18.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:18.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:18.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:18.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:19.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:19.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:19.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:19.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:20.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:20.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:20.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:20.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:21.073 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:21.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:21.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:21.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:22.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:22.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:22.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:22.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:23.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:23.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:23.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:23.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:24.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:24.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:24.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:24.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:25.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:25.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:25.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:25.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:26.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:26.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:26.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:26.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:27.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:27.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:27.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:27.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:28.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:28.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:28.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:28.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:29.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:29.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:29.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:29.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:30.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:30.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:30.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:30.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:31.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:31.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:31.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:31.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:32.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:32.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:32.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:32.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:33.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:33.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:33.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:33.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:34.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:34.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:34.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:34.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:35.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:35.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:35.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:35.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:36.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:36.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:36.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:36.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:37.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:37.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:37.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:37.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:38.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:38.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:38.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:38.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:39.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:39.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:39.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:39.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:40.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:40.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:40.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:40.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:41.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:41.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:41.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:41.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:42.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:42.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:42.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:42.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:43.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:43.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:43.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:43.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:44.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:44.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:44.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:44.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:45.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:45.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:45.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:45.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:46.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:46.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:46.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:46.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:47.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:47.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:47.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:47.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:48.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:48.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:48.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:48.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:49.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:49.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:49.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:49.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:50.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:50.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:50.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:50.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:51.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:51.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:51.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:51.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:52.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:52.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:52.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:52.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:53.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:53.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:53.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:53.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:54.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:54.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:54.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:54.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:55.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:55.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:55.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:55.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:56.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:56.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:56.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:57.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:57.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:57.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:57.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:58.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:58.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:58.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:58.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:59.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:37:59.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:37:59.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:37:59.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:00.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:00.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:00.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:00.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:01.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:01.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:01.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:01.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:02.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:02.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:02.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:02.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:03.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:03.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:03.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:03.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:04.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:04.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:04.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:04.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:05.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:05.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:05.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:05.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:06.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:06.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:06.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:06.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:07.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:07.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:07.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:07.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:08.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:08.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:08.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:08.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:09.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:09.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:09.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:09.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:10.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:10.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:10.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:10.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:11.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:11.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:11.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:11.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:12.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:12.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:12.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:12.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:13.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:13.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:13.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:13.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:14.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:14.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:14.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:14.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:15.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:15.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:15.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:15.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:16.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:16.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:16.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:16.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:17.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:17.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:17.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:17.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:18.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:18.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:18.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:18.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:19.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:19.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:19.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:19.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:20.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:20.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:20.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:20.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:21.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:21.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:21.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:21.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:22.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:22.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:22.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:22.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:23.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:23.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:23.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:23.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:24.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:24.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:24.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:24.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:25.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:25.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:25.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:25.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:26.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:26.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:26.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:26.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:27.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:27.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:27.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:27.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:28.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:28.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:28.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:28.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:29.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:29.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:29.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:29.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:30.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:30.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:30.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:30.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:31.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:31.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:31.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:31.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:32.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:32.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:32.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:32.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:33.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:33.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:33.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:33.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:34.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:34.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:34.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:34.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:35.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:35.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:35.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:35.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:36.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:36.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:36.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:36.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:37.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:37.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:37.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:37.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:38.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:38.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:38.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:38.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:39.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:39.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:39.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:39.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:40.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:40.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:40.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:40.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:41.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:41.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:41.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:41.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:42.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:42.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:42.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:42.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:43.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:43.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:43.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:43.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:44.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:44.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:44.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:44.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:45.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:45.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:45.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:45.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:46.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:46.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:46.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:46.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:47.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:47.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:47.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:47.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:48.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:48.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:48.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:48.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:49.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:49.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:49.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:49.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:50.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:50.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:50.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:50.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:51.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:51.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:51.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:51.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:52.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:52.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:52.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:52.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:53.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:53.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:53.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:53.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:54.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:54.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:54.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:54.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:55.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:55.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:55.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:55.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:56.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:56.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:56.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:56.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:57.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:57.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:57.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:57.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:58.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:58.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:58.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:58.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:59.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:38:59.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:38:59.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:38:59.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:00.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:00.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:00.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:00.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:01.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:01.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:01.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:01.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:02.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:02.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:02.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:02.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:03.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:03.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:03.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:03.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:04.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:04.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:04.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:04.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:05.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:05.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:05.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:05.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:06.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:06.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:06.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:06.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:07.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:07.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:07.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:07.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:08.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:08.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:08.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:08.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:09.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:09.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:09.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:09.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:10.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:10.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:10.563 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:10.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:11.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:11.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:11.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:11.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:12.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:12.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:12.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:12.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:13.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:13.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:13.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:13.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:14.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:14.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:14.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:14.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:15.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:15.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:15.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:15.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:16.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:16.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:16.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:16.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:17.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:17.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:17.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:17.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:18.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:18.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:18.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:18.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:19.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:19.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:19.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:19.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:20.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:20.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:20.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:20.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:21.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:21.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:21.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:21.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:22.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:22.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:22.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:22.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:23.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:23.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:23.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:23.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:24.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:24.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:24.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:24.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:25.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:25.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:25.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:25.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:26.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:26.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:26.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:26.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:27.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:27.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:27.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:27.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:28.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:28.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:28.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:28.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:29.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:29.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:29.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:29.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:30.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:30.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:30.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:30.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:31.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:31.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:31.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:31.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:32.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:32.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:32.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:32.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:33.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:33.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:33.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:33.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:34.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:34.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:34.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:34.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:35.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:35.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:35.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:35.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:36.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:36.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:36.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:36.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:37.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:37.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:37.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:37.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:38.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:38.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:38.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:38.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:39.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:39.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:39.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:40.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:40.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:40.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:40.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:41.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:41.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:41.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:41.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:42.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:42.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:42.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:42.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:43.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:43.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:43.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:43.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:44.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:44.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:44.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:44.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:45.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:45.301+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:45.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:45.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:46.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:46.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:46.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:46.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:47.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:47.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:47.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:47.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:48.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:48.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:48.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:48.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:49.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:49.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:49.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:49.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:50.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:50.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:50.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:50.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:51.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:51.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:51.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:51.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:52.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:52.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:52.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:52.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:53.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:53.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:53.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:53.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:54.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:54.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:54.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:54.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:55.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:55.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:55.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:55.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:56.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:56.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:56.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:56.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:57.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:57.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:57.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:57.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:58.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:58.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:58.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:58.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:59.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:39:59.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:39:59.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:39:59.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:00.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:00.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:00.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:00.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:01.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:01.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:01.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:01.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:02.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:02.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:02.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:02.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:03.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:03.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:03.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:03.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:04.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:04.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:04.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:04.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:05.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:05.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:05.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:05.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:06.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:06.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:06.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:06.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:07.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:07.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:07.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:07.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:08.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:08.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:08.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:08.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:09.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:09.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:09.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:09.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:10.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:10.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:10.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:10.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:11.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:11.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:11.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:11.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:12.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:12.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:12.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:12.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:13.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:13.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:13.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:13.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:14.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:14.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:14.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:14.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:15.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:15.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:15.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:15.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:16.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:16.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:16.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:16.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:17.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:17.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:17.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:17.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:18.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:18.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:18.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:18.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:19.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:19.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:19.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:19.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:20.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:20.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:20.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:20.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:21.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:21.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:21.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:21.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:22.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:22.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:22.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:22.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:23.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:23.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:23.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:23.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:24.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:24.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:24.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:24.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:25.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:25.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:25.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:25.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:26.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:26.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:26.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:26.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:27.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:27.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:27.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:27.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:28.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:28.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:28.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:28.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:29.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:29.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:29.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:29.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:30.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:30.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:30.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:30.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:31.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:31.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:31.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:31.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:32.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:32.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:32.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:32.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:33.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:33.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:33.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:33.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:34.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:34.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:34.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:34.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:35.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:35.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:35.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:35.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:36.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:36.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:36.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:36.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:37.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:37.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:37.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:37.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:38.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:38.316+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:38.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:38.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:39.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:39.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:39.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:39.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:40.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:40.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:40.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:40.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:41.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:41.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:41.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:41.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:42.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:42.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:42.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:42.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:43.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:43.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:43.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:43.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:44.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:44.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:44.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:44.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:45.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:45.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:45.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:45.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:46.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:46.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:46.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:46.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:47.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:47.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:47.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:47.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:48.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:48.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:48.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:48.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:49.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:49.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:49.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:49.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:50.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:50.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:50.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:50.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:51.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:51.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:51.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:51.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:52.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:52.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:52.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:52.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:53.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:53.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:53.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:53.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:54.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:54.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:54.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:54.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:55.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:55.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:55.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:55.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:56.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:56.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:56.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:56.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:57.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:57.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:57.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:57.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:58.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:58.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:58.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:58.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:59.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:40:59.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:40:59.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:40:59.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:00.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:00.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:00.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:00.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:01.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:01.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:01.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:01.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:02.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:02.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:02.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:02.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:03.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:03.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:03.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:03.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:04.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:04.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:04.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:04.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:05.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:05.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:05.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:05.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:06.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:06.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:06.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:06.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:07.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:07.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:07.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:07.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:08.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:08.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:08.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:08.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:09.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:09.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:09.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:09.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:10.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:10.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:10.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:10.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:11.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:11.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:11.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:11.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:12.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:12.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:12.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:12.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:13.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:13.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:13.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:13.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:14.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:14.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:14.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:14.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:15.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:15.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:15.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:15.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:16.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:16.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:16.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:16.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:17.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:17.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:17.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:17.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:18.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:18.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:18.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:18.487+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:19.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:19.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:19.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:19.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:20.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:20.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:20.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:20.539+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:21.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:21.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:21.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:21.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:22.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:22.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:22.593 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:22.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:23.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:23.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:23.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:23.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:24.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:24.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:24.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:24.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:25.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:25.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:25.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:25.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:26.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:26.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:26.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:26.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:27.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:27.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:27.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:27.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:28.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:28.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:28.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:28.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:29.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:29.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:29.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:29.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:30.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:30.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:30.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:30.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:31.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:31.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:31.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:31.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:32.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:32.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:32.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:32.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:33.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:33.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:33.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:33.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:34.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:34.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:34.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:34.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:35.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:35.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:35.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:35.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:36.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:36.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:36.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:36.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:37.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:37.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:37.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:37.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:38.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:38.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:38.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:38.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:39.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:39.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:39.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:39.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:40.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:40.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:40.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:40.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:41.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:41.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:41.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:41.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:42.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:42.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:42.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:42.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:43.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:43.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:43.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:43.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:44.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:44.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:44.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:44.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:45.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:45.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:45.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:45.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:46.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:46.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:46.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:46.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:47.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:47.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:47.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:47.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:48.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:48.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:48.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:48.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:49.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:49.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:49.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:49.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:50.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:50.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:50.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:50.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:51.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:51.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:51.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:51.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:52.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:52.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:52.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:52.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:53.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:53.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:53.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:53.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:54.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:54.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:54.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:54.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:55.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:55.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:55.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:55.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:56.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:56.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:56.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:56.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:57.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:57.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:57.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:57.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:58.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:58.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:58.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:58.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:59.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:41:59.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:41:59.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:41:59.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:00.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:00.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:00.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:00.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:01.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:01.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:01.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:01.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:02.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:02.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:02.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:02.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:03.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:03.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:03.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:03.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:04.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:04.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:04.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:04.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:05.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:05.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:05.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:05.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:06.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:06.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:06.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:06.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:07.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:07.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:07.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:07.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:08.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:08.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:08.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:08.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:09.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:09.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:09.496 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:09.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:10.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:10.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:10.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:10.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:11.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:11.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:11.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:11.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:12.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:12.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:12.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:12.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:13.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:13.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:13.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:13.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:14.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:14.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:14.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:14.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:15.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:15.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:15.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:15.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:16.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:16.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:16.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:16.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:17.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:17.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:17.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:17.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:18.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:18.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:18.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:18.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:19.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:19.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:19.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:19.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:20.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:20.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:20.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:20.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:21.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:21.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:21.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:21.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:22.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:22.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:22.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:22.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:23.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:23.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:23.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:23.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:24.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:24.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:24.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:24.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:25.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:25.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:25.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:25.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:26.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:26.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:26.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:26.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:27.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:27.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:27.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:27.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:28.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:28.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:28.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:28.617+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:29.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:29.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:29.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:29.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:30.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:30.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:30.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:30.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:31.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:31.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:31.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:31.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:32.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:32.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:32.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:32.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:33.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:33.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:33.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:33.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:34.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:34.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:34.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:34.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:35.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:35.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:35.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:35.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:36.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:36.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:36.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:36.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:37.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:37.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:37.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:37.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:38.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:38.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:38.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:38.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:39.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:39.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:39.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:39.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:40.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:40.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:40.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:40.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:41.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:41.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:41.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:41.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:42.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:42.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:42.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:42.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:43.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:43.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:43.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:43.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:44.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:44.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:44.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:44.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:45.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:45.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:45.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:45.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:46.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:46.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:46.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:46.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:47.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:47.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:47.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:47.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:48.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:48.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:48.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:48.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:49.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:49.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:49.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:49.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:50.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:50.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:50.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:50.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:51.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:51.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:51.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:51.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:52.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:52.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:52.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:52.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:53.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:53.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:53.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:53.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:54.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:54.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:54.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:54.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:55.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:55.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:55.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:55.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:56.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:56.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:56.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:56.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:57.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:57.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:57.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:57.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:58.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:58.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:58.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:58.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:59.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:42:59.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:42:59.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:42:59.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:00.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:00.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:00.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:00.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:01.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:01.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:01.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:01.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:02.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:02.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:02.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:02.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:03.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:03.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:03.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:03.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:04.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:04.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:04.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:04.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:05.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:05.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:05.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:05.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:06.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:06.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:06.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:06.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:07.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:07.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:07.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:07.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:08.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:08.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:08.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:08.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:09.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:09.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:09.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:09.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:10.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:10.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:10.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:10.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:11.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:11.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:11.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:11.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:12.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:12.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:12.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:12.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:13.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:13.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:13.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:13.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:14.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:14.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:14.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:14.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:15.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:15.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:15.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:15.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:16.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:16.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:16.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:16.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:17.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:17.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:17.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:17.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:18.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:18.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:18.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:18.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:19.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:19.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:19.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:19.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:20.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:20.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:20.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:20.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:21.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:21.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:21.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:21.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:22.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:22.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:22.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:22.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:23.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:23.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:23.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:23.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:24.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:24.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:24.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:24.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:25.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:25.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:25.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:25.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:26.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:26.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:26.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:26.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:27.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:27.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:27.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:27.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:28.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:28.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:28.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:28.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:29.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:29.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:29.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:29.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:30.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:30.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:30.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:30.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:31.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:31.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:31.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:31.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:32.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:32.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:32.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:33.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:33.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:33.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:33.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:34.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:34.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:34.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:34.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:35.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:35.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:35.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:35.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:36.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:36.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:36.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:36.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:37.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:37.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:37.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:37.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:38.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:38.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:38.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:38.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:39.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:39.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:39.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:39.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:40.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:40.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:40.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:40.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:41.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:41.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:41.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:41.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:42.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:42.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:42.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:42.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:43.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:43.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:43.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:43.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:44.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:44.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:44.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:44.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:45.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:45.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:45.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:45.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:46.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:46.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:46.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:46.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:47.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:47.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:47.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:47.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:48.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:48.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:48.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:48.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:49.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:49.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:49.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:49.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:50.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:50.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:50.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:50.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:51.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:51.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:51.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:51.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:52.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:52.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:52.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:52.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:53.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:53.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:53.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:53.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:54.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:54.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:54.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:54.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:55.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:55.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:55.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:55.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:56.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:56.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:56.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:56.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:57.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:57.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:57.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:57.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:58.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:58.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:58.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:58.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:59.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:43:59.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:43:59.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:43:59.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:00.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:00.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:00.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:00.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:01.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:01.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:01.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:01.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:02.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:02.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:02.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:02.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:03.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:03.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:03.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:03.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:04.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:04.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:04.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:04.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:05.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:05.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:05.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:05.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:06.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:06.519+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:06.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:06.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:07.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:07.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:07.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:07.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:08.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:08.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:08.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:08.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:09.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:09.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:09.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:09.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:10.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:10.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:10.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:10.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:11.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:11.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:11.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:11.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:12.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:12.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:12.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:12.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:13.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:13.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:13.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:13.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:14.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:14.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:14.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:14.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:15.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:15.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:15.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:15.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:16.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:16.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:16.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:16.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:17.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:17.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:17.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:17.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:18.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:18.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:18.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:18.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:19.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:19.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:19.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:19.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:20.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:20.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:20.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:20.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:21.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:21.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:21.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:21.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:22.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:22.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:22.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:22.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:23.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:23.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:23.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:23.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:24.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:24.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:24.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:24.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:25.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:25.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:25.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:25.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:26.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:26.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:26.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:26.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:27.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:27.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:27.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:27.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:28.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:28.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:28.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:28.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:29.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:29.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:29.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:29.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:30.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:30.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:30.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:30.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:31.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:31.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:31.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:31.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:32.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:32.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:32.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:32.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:33.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:33.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:33.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:33.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:34.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:34.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:34.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:34.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:35.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:35.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:35.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:35.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:36.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:36.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:36.755 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:36.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:37.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:37.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:37.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:37.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:38.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:38.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:38.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:38.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:39.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:39.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:39.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:39.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:40.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:40.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:40.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:40.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:41.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:41.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:41.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:41.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:42.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:42.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:42.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:42.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:43.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:43.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:43.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:43.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:44.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:44.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:44.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:44.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:45.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:45.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:45.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:45.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:46.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:46.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:46.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:46.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:47.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:47.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:47.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:47.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:48.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:48.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:48.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:48.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:49.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:49.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:49.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:49.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:50.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:50.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:50.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:50.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:51.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:51.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:51.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:51.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:52.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:52.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:52.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:52.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:53.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:53.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:53.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:53.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:54.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:54.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:54.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:54.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:55.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:55.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:55.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:55.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:56.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:56.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:56.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:56.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:57.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:57.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:57.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:57.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:58.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:58.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:58.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:58.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:59.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:44:59.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:44:59.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:44:59.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:00.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:00.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:00.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:00.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:01.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:01.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:01.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:01.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:02.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:02.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:02.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:02.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:03.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:03.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:03.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:03.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:04.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:04.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:04.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:04.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:05.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:05.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:05.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:05.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:06.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:06.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:06.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:06.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:07.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:07.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:07.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:07.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:08.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:08.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:08.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:08.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:09.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:09.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:09.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:09.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:10.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:10.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:10.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:10.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:11.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:11.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:11.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:11.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:12.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:12.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:12.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:12.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:13.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:13.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:13.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:13.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:14.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:14.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:14.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:14.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:15.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:15.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:15.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:15.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:16.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:16.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:16.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:16.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:17.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:17.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:17.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:17.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:18.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:18.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:18.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:18.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:19.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:19.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:19.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:19.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:20.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:20.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:20.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:20.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:21.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:21.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:21.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:21.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:22.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:22.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:22.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:22.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:23.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:23.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:23.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:23.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:24.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:24.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:24.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:24.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:25.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:25.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:25.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:25.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:26.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:26.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:26.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:26.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:27.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:27.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:27.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:27.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:28.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:28.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:28.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:28.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:29.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:29.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:29.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:29.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:30.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:30.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:30.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:30.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:31.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:31.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:31.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:31.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:32.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:32.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:32.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:32.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:33.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:33.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:33.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:33.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:34.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:34.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:34.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:34.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:35.465 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:35.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:35.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:35.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:36.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:36.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:36.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:36.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:37.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:37.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:37.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:37.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:38.464 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:38.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:38.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:38.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:39.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:39.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:39.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:39.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:40.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:40.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:40.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:40.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:41.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:41.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:41.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:41.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:42.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:42.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:42.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:42.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:43.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:43.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:43.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:43.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:44.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:44.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:44.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:44.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:45.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:45.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:45.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:45.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:46.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:46.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:46.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:46.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:47.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:47.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:47.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:47.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:48.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:48.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:48.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:48.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:49.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:49.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:49.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:49.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:50.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:50.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:50.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:50.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:51.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:51.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:51.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:51.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:52.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:52.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:52.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:52.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:53.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:53.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:53.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:53.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:54.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:54.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:54.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:54.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:55.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:55.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:55.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:55.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:56.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:56.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:56.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:56.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:57.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:57.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:57.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:57.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:58.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:58.536+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:58.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:58.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:59.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:45:59.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:45:59.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:45:59.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:00.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:00.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:00.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:00.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:01.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:01.468+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:01.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:01.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:02.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:02.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:02.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:02.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:03.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:03.412+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:03.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:03.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:04.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:04.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:04.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:04.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:05.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:05.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:05.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:05.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:06.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:06.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:06.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:06.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:07.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:07.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:07.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:07.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:08.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:08.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:08.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:08.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:09.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:09.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:09.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:09.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:10.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:10.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:10.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:10.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:11.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:11.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:11.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:11.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:12.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:12.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:12.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:12.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:13.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:13.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:13.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:13.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:14.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:14.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:14.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:14.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:15.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:15.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:15.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:15.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:16.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:16.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:16.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:16.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:17.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:17.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:17.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:17.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:18.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:18.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:18.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:18.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:19.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:19.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:19.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:19.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:20.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:20.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:20.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:20.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:21.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:21.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:21.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:21.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:22.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:22.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:22.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:22.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:23.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:23.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:23.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:23.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:24.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:24.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:24.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:24.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:25.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:25.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:25.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:25.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:26.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:26.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:26.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:26.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:27.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:27.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:27.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:27.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:28.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:28.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:28.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:28.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:29.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:29.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:29.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:29.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:30.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:30.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:30.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:30.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:31.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:31.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:31.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:31.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:32.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:32.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:32.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:32.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:33.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:33.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:33.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:34.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:34.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:34.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:34.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:35.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:35.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:35.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:35.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:36.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:36.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:36.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:36.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:37.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:37.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:37.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:37.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:38.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:38.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:38.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:38.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:39.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:39.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:39.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:39.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:40.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:40.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:40.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:40.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:41.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:41.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:41.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:41.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:42.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:42.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:42.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:42.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:43.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:43.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:43.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:43.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:44.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:44.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:44.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:44.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:45.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:45.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:45.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:45.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:46.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:46.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:46.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:46.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:47.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:47.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:47.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:47.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:48.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:48.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:48.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:48.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:49.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:49.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:49.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:49.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:50.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:50.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:50.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:50.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:51.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:51.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:51.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:51.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:52.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:52.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:52.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:52.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:53.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:53.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:53.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:53.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:54.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:54.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:54.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:54.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:55.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:55.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:55.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:55.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:56.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:56.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:56.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:56.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:57.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:57.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:57.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:57.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:58.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:58.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:58.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:58.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:59.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:46:59.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:46:59.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:46:59.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:00.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:00.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:00.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:00.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:01.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:01.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:01.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:01.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:02.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:02.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:02.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:02.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:03.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:03.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:03.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:03.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:04.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:04.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:04.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:04.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:05.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:05.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:05.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:05.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:06.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:06.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:06.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:06.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:07.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:07.435+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:07.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:07.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:08.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:08.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:08.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:08.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:09.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:09.431+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:09.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:09.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:10.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:10.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:10.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:10.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:11.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:11.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:11.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:11.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:12.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:12.503+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:12.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:12.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:13.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:13.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:13.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:13.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:14.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:14.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:14.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:14.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:15.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:15.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:15.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:15.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:16.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:16.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:16.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:16.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:17.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:17.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:17.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:17.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:18.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:18.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:18.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:18.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:19.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:19.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:19.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:19.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:20.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:20.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:20.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:20.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:21.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:21.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:21.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:21.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:22.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:22.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:22.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:22.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:23.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:23.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:23.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:23.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:24.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:24.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:24.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:24.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:25.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:25.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:25.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:25.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:26.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:26.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:26.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:26.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:27.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:27.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:27.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:27.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:28.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:28.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:28.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:28.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:29.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:29.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:29.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:29.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:30.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:30.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:30.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:30.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:31.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:31.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:31.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:31.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:32.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:32.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:32.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:32.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:33.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:33.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:33.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:33.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:34.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:34.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:34.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:34.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:35.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:35.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:35.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:35.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:36.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:36.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:36.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:36.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:37.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:37.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:37.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:37.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:38.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:38.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:38.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:38.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:39.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:39.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:39.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:39.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:40.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:40.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:40.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:40.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:41.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:41.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:41.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:41.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:42.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:42.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:42.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:42.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:43.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:43.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:43.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:43.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:44.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:44.306+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:44.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:44.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:45.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:45.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:45.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:45.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:46.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:46.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:46.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:46.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:47.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:47.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:47.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:47.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:48.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:48.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:48.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:48.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:49.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:49.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:49.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:49.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:50.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:50.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:50.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:50.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:51.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:51.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:51.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:51.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:52.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:52.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:52.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:52.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:53.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:53.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:53.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:53.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:54.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:54.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:54.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:54.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:55.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:55.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:55.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:55.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:56.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:56.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:56.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:56.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:57.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:57.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:57.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:57.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:58.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:58.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:58.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:58.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:59.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:47:59.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:47:59.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:47:59.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:00.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:00.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:00.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:00.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:01.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:01.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:01.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:01.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:02.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:02.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:02.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:02.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:03.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:03.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:03.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:03.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:04.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:04.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:04.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:04.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:05.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:05.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:05.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:05.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:06.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:06.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:06.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:06.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:07.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:07.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:07.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:07.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:08.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:08.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:08.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:08.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:09.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:09.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:09.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:09.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:10.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:10.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:10.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:10.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:11.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:11.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:11.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:11.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:12.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:12.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:12.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:12.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:13.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:13.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:13.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:13.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:14.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:14.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:14.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:14.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:15.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:15.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:15.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:15.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:16.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:16.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:16.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:16.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:17.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:17.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:17.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:17.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:18.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:18.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:18.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:18.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:19.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:19.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:19.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:19.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:20.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:20.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:20.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:20.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:21.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:21.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:21.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:21.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:22.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:22.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:22.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:22.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:23.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:23.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:23.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:23.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:24.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:24.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:24.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:24.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:25.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:25.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:25.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:25.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:26.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:26.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:26.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:26.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:27.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:27.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:27.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:27.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:28.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:28.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:28.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:28.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:29.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:29.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:29.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:29.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:30.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:30.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:30.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:30.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:31.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:31.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:31.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:31.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:32.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:32.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:32.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:32.953+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:33.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:33.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:33.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:33.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:34.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:34.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:35.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:35.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:35.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:35.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:35.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:35.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:36.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:36.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:36.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:36.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:37.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:37.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:37.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:37.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:38.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:38.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:38.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:38.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:39.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:39.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:39.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:39.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:40.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:40.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:40.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:40.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:41.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:41.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:41.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:41.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:42.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:42.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:42.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:42.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:43.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:43.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:43.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:43.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:44.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:44.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:44.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:44.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:45.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:45.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:45.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:45.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:46.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:46.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:46.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:46.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:47.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:47.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:47.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:47.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:48.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:48.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:48.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:48.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:49.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:49.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:49.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:49.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:50.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:50.480+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:50.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:50.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:51.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:51.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:51.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:51.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:52.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:52.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:52.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:52.728+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:53.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:53.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:53.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:53.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:54.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:54.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:54.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:54.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:55.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:55.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:55.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:55.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:56.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:56.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:56.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:56.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:57.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:57.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:57.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:57.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:58.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:58.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:58.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:58.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:59.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:48:59.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:48:59.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:48:59.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:00.571 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:00.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:00.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:00.752+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:01.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:01.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:01.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:01.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:02.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:02.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:02.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:02.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:03.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:03.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:03.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:03.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:04.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:04.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:04.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:04.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:05.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:05.612+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:05.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:05.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:06.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:06.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:06.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:06.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:07.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:07.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:07.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:07.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:08.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:08.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:08.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:08.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:09.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:09.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:09.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:09.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:10.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:10.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:10.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:10.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:11.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:11.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:11.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:11.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:12.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:12.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:12.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:12.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:13.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:13.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:13.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:13.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:14.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:14.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:14.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:14.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:15.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:15.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:15.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:15.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:16.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:16.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:16.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:16.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:17.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:17.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:17.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:17.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:18.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:18.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:18.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:18.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:19.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:19.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:19.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:19.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:20.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:20.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:20.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:20.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:21.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:21.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:21.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:21.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:22.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:22.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:22.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:22.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:23.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:23.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:23.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:23.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:24.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:24.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:24.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:24.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:25.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:25.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:25.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:25.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:26.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:26.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:26.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:26.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:27.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:27.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:27.827 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:27.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:28.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:28.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:28.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:28.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:29.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:29.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:29.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:29.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:30.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:30.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:30.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:30.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:31.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:31.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:31.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:31.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:32.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:32.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:32.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:32.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:33.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:33.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:33.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:33.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:34.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:34.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:34.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:34.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:35.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:35.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:35.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:35.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:36.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:36.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:36.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:36.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:37.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:37.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:37.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:37.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:38.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:38.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:38.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:38.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:39.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:39.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:39.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:39.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:40.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:40.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:40.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:40.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:41.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:41.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:41.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:41.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:42.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:42.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:42.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:42.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:43.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:43.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:43.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:43.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:44.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:44.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:44.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:44.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:45.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:45.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:45.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:45.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:46.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:46.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:46.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:46.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:47.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:47.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:47.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:47.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:48.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:48.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:48.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:48.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:49.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:49.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:49.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:49.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:50.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:50.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:50.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:50.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:51.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:51.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:51.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:51.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:52.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:52.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:52.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:52.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:53.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:53.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:53.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:53.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:54.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:54.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:54.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:54.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:55.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:55.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:55.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:55.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:56.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:56.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:56.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:56.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:57.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:57.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:57.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:57.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:58.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:58.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:58.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:58.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:59.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:49:59.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:49:59.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:49:59.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:00.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:00.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:00.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:00.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:01.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:01.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:01.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:01.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:02.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:02.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:02.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:02.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:03.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:03.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:03.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:03.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:04.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:04.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:04.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:04.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:05.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:05.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:05.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:05.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:06.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:06.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:06.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:06.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:07.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:07.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:07.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:07.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:08.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:08.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:08.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:08.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:09.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:09.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:09.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:09.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:10.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:10.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:10.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:10.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:11.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:11.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:11.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:11.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:12.678 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:12.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:12.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:12.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:13.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:13.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:13.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:13.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:14.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:14.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:14.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:14.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:15.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:15.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:15.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:15.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:16.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:16.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:16.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:16.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:17.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:17.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:17.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:17.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:18.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:18.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:18.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:18.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:19.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:19.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:19.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:19.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:20.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:20.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:20.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:20.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:21.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:21.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:21.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:21.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:22.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:22.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:22.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:22.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:23.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:23.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:23.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:23.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:24.538 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:24.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:24.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:24.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:25.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:25.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:25.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:25.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:26.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:26.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:26.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:26.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:27.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:27.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:27.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:27.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:28.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:28.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:28.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:28.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:29.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:29.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:29.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:29.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:30.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:30.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:30.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:30.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:31.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:31.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:31.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:31.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:32.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:32.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:32.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:32.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:33.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:33.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:33.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:33.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:34.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:34.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:34.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:34.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:35.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:35.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:35.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:35.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:36.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:36.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:36.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:36.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:37.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:37.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:37.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:37.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:38.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:38.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:38.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:38.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:39.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:39.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:39.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:39.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:40.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:40.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:40.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:40.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:41.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:41.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:41.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:41.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:42.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:42.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:42.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:42.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:43.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:43.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:43.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:43.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:44.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:44.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:44.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:44.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:45.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:45.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:45.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:45.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:46.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:46.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:46.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:46.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:47.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:47.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:47.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:47.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:48.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:48.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:48.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:48.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:49.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:49.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:49.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:49.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:50.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:50.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:50.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:50.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:51.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:51.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:51.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:51.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:52.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:52.645+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:52.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:52.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:53.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:53.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:53.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:53.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:54.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:54.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:54.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:54.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:55.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:55.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:55.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:55.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:56.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:56.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:56.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:56.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:57.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:57.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:57.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:57.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:58.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:58.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:58.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:58.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:59.557 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:50:59.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:50:59.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:50:59.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:00.564 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:00.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:00.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:00.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:01.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:01.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:01.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:01.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:02.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:02.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:02.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:02.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:03.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:03.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:03.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:03.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:04.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:04.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:04.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:04.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:05.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:05.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:05.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:05.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:06.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:06.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:06.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:06.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:07.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:07.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:07.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:07.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:08.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:08.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:08.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:08.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:09.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:09.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:09.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:09.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:10.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:10.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:10.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:10.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:11.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:11.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:11.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:11.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:12.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:12.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:12.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:12.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:13.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:13.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:13.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:13.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:14.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:14.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:14.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:14.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:15.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:15.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:15.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:15.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:16.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:16.681+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:16.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:16.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:17.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:17.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:17.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:17.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:18.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:18.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:18.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:18.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:19.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:19.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:19.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:19.753+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:20.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:20.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:20.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:20.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:21.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:21.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:21.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:21.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:22.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:22.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:22.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:22.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:23.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:23.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:23.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:23.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:24.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:24.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:24.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:24.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:25.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:25.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:25.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:25.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:26.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:26.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:26.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:26.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:27.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:27.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:27.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:27.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:28.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:28.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:28.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:28.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:29.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:29.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:29.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:29.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:30.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:30.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:30.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:30.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:31.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:31.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:31.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:31.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:32.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:32.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:32.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:32.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:33.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:33.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:33.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:33.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:34.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:34.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:34.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:34.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:35.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:35.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:35.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:35.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:36.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:36.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:36.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:36.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:37.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:37.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:37.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:37.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:38.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:38.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:38.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:38.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:39.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:39.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:39.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:39.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:40.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:40.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:40.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:40.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:41.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:41.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:41.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:41.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:42.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:42.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:42.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:42.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:43.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:43.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:43.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:43.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:44.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:44.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:44.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:44.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:45.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:45.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:45.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:45.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:46.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:46.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:46.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:46.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:47.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:47.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:47.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:47.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:48.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:48.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:48.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:48.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:49.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:49.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:49.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:49.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:50.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:50.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:50.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:50.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:51.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:51.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:51.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:51.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:52.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:52.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:52.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:52.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:53.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:53.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:53.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:53.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:54.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:54.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:54.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:54.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:55.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:55.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:55.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:55.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:56.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:56.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:56.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:56.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:57.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:57.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:57.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:57.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:58.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:58.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:58.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:58.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:59.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:51:59.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:51:59.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:51:59.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:00.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:00.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:00.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:00.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:01.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:01.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:01.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:01.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:02.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:02.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:02.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:02.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:03.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:03.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:03.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:03.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:04.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:04.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:04.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:04.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:05.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:05.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:05.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:05.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:06.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:06.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:06.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:06.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:07.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:07.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:08.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:07.996+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:08.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:08.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:08.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:08.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:09.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:09.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:09.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:09.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:10.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:10.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:11.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:10.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:11.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:11.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:12.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:12.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:12.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:12.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:13.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:13.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:13.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:13.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:14.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:14.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:14.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:14.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:15.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:15.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:15.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:15.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:16.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:16.079+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:16.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:16.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:17.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:17.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:17.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:17.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:18.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:18.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:18.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:18.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:19.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:19.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:19.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:19.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:20.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:20.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:20.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:20.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:21.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:21.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:21.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:21.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:22.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:22.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:22.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:22.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:23.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:23.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:23.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:23.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:24.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:24.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:24.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:24.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:25.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:25.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:25.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:25.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:26.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:26.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:26.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:26.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:27.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:27.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:27.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:27.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:28.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:28.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:28.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:28.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:29.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:29.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:29.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:29.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:30.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:30.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:30.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:30.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:31.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:31.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:31.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:31.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:32.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:32.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:32.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:32.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:33.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:33.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:33.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:33.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:34.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:34.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:34.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:34.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:35.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:35.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:35.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:35.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:36.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:36.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:36.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:36.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:37.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:37.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:37.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:37.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:38.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:38.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:38.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:38.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:39.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:39.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:39.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:39.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:40.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:40.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:40.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:40.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:41.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:41.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:41.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:41.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:42.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:42.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:42.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:42.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:43.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:43.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:43.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:43.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:44.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:44.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:44.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:44.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:45.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:45.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:45.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:45.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:46.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:46.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:46.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:46.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:47.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:47.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:47.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:47.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:48.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:48.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:48.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:49.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:49.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:49.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:49.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:50.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:50.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:50.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:50.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:51.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:51.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:51.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:51.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:52.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:52.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:52.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:52.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:53.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:53.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:53.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:53.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:54.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:54.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:54.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:54.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:55.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:55.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:55.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:55.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:56.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:56.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:56.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:56.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:57.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:57.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:57.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:57.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:58.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:58.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:58.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:58.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:59.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:52:59.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:52:59.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:52:59.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:00.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:00.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:00.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:00.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:01.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:01.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:01.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:01.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:02.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:02.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:02.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:02.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:03.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:03.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:03.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:03.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:04.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:04.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:04.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:04.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:05.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:05.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:05.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:05.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:06.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:06.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:06.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:06.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:07.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:07.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:07.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:07.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:08.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:08.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:08.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:08.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:09.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:09.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:09.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:09.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:10.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:10.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:10.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:10.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:11.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:11.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:11.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:11.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:12.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:12.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:12.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:12.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:13.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:13.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:13.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:13.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:14.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:14.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:14.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:14.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:15.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:15.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:15.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:15.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:16.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:16.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:16.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:16.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:17.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:17.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:17.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:17.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:18.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:18.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:18.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:18.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:19.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:19.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:19.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:19.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:20.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:20.466+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:20.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:20.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:21.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:21.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:21.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:21.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:22.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:22.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:22.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:22.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:23.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:23.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:23.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:23.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:24.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:24.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:24.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:24.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:25.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:25.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:25.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:25.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:26.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:26.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:26.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:26.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:27.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:27.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:28.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:28.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:28.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:28.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:28.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:28.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:29.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:29.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:30.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:30.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:30.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:30.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:31.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:31.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:31.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:31.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:32.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:32.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:32.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:32.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:32.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:32.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:33.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:33.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:33.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:33.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:34.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:34.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:34.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:34.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:35.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:35.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:35.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:35.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:36.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:36.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:36.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:36.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:37.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:37.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:37.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:37.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:38.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:38.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:38.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:38.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:39.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:39.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:39.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:39.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:40.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:40.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:40.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:40.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:41.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:41.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:41.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:41.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:42.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:42.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:42.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:42.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:43.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:43.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:43.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:43.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:44.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:44.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:44.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:44.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:45.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:45.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:45.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:45.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:46.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:46.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:47.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:46.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:47.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:47.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:48.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:48.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:48.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:48.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:48.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:48.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:49.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:49.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:49.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:49.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:50.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:50.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:50.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:50.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:51.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:51.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:51.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:51.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:52.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:52.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:52.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:52.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:53.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:53.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:53.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:53.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:54.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:54.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:54.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:54.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:55.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:55.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:56.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:56.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:56.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:56.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:57.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:57.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:57.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:57.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:58.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:58.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:58.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:58.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:59.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:53:59.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:53:59.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:53:59.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:00.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:00.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:00.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:00.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:01.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:01.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:01.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:01.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:02.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:02.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:02.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:02.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:03.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:03.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:03.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:03.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:04.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:04.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:04.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:04.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:05.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:05.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:05.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:05.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:06.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:06.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:06.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:06.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:07.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:07.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:07.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:07.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:08.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:08.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:08.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:08.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:09.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:09.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:09.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:09.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:10.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:10.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:10.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:10.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:11.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:11.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:11.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:11.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:12.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:12.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:12.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:12.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:13.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:13.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:13.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:13.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:14.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:14.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:14.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:14.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:15.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:15.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:15.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:15.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:16.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:16.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:16.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:16.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:17.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:17.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:17.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:17.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:18.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:18.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:18.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:18.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:18.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:18.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:19.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:19.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:20.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:20.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:20.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:20.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:21.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:21.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:21.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:21.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:22.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:22.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:22.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:22.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:23.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:23.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:23.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:23.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:24.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:24.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:24.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:24.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:25.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:25.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:25.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:25.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:25.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:25.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:26.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:26.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:26.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:26.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:27.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:27.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:27.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:27.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:28.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:28.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:28.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:28.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:29.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:29.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:29.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:29.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:30.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:30.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:30.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:30.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:31.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:31.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:31.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:31.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:32.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:32.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:32.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:32.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:33.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:33.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:33.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:33.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:34.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:34.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:34.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:34.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:35.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:35.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:35.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:35.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:36.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:36.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:36.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:36.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:37.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:37.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:37.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:37.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:38.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:38.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:38.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:38.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:39.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:39.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:39.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:39.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:40.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:40.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:40.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:40.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:41.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:41.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:41.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:41.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:42.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:42.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:42.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:42.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:43.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:43.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:43.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:43.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:44.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:44.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:44.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:44.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:45.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:45.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:45.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:45.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:46.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:46.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:46.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:46.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:47.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:47.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:47.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:47.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:48.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:48.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:48.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:48.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:49.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:49.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:49.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:49.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:50.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:50.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:50.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:50.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:51.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:51.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:51.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:51.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:52.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:52.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:52.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:52.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:53.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:53.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:53.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:53.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:54.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:54.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:54.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:54.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:55.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:55.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:55.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:55.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:56.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:56.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:56.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:56.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:57.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:57.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:57.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:57.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:58.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:58.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:58.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:58.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:59.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:54:59.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:54:59.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:54:59.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:00.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:00.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:00.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:00.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:01.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:01.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:01.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:01.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:02.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:02.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:02.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:02.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:03.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:03.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:03.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:03.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:04.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:04.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:04.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:04.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:05.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:05.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:05.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:05.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:06.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:06.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:06.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:06.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:07.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:07.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:07.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:07.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:08.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:08.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:08.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:08.687+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:09.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:09.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:09.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:09.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:10.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:10.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:10.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:10.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:11.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:11.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:11.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:11.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:12.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:12.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:12.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:12.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:13.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:13.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:13.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:13.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:14.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:14.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:14.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:14.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:15.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:15.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:15.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:15.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:16.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:16.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:16.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:16.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:17.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:17.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:17.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:17.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:18.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:18.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:18.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:18.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:19.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:19.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:19.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:19.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:20.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:20.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:20.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:20.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:21.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:21.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:21.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:21.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:22.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:22.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:22.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:22.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:23.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:23.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:23.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:23.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:24.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:24.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:24.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:24.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:25.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:25.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:25.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:25.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:26.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:26.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:26.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:26.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:27.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:27.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:27.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:27.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:28.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:28.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:28.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:28.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:29.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:29.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:29.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:29.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:30.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:30.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:30.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:30.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:31.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:31.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:31.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:31.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:32.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:32.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:32.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:32.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:33.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:33.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:33.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:33.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:34.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:34.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:34.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:34.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:35.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:35.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:35.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:35.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:36.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:36.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:36.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:36.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:37.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:37.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:37.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:37.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:38.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:38.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:38.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:38.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:39.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:39.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:39.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:39.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:40.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:40.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:40.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:40.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:41.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:41.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:41.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:41.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:42.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:42.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:42.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:42.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:43.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:43.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:43.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:43.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:44.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:44.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:44.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:44.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:45.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:45.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:45.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:45.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:46.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:46.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:46.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:46.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:47.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:47.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:47.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:47.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:48.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:48.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:48.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:48.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:49.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:49.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:49.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:49.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:50.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:50.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:50.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:50.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:51.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:51.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:51.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:51.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:52.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:52.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:52.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:52.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:53.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:53.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:53.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:53.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:54.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:54.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:54.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:54.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:55.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:55.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:55.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:55.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:56.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:56.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:56.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:56.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:57.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:57.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:57.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:57.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:58.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:58.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:58.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:58.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:59.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:55:59.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:55:59.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:55:59.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:00.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:00.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:00.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:00.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:01.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:01.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:01.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:01.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:02.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:02.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:02.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:02.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:03.415 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:03.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:03.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:03.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:04.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:04.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:04.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:04.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:05.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:05.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:05.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:05.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:06.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:06.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:06.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:06.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:07.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:07.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:07.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:07.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:08.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:08.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:08.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:08.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:09.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:09.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:09.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:09.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:10.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:10.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:10.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:10.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:11.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:11.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:11.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:11.802+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:12.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:12.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:12.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:12.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:13.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:13.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:13.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:13.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:14.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:14.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:14.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:14.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:15.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:15.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:15.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:15.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:16.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:16.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:16.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:16.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:17.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:17.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:17.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:17.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:18.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:18.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:18.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:18.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:19.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:19.246+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:19.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:19.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:20.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:20.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:20.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:20.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:21.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:21.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:21.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:21.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:22.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:22.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:22.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:22.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:23.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:23.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:23.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:23.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:24.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:24.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:24.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:24.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:25.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:25.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:25.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:25.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:26.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:26.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:26.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:26.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:27.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:27.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:27.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:27.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:28.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:28.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:28.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:28.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:29.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:29.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:29.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:29.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:30.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:30.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:30.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:30.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:31.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:31.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:31.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:31.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:32.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:32.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:32.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:32.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:33.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:33.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:33.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:33.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:34.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:34.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:34.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:34.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:35.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:35.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:35.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:35.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:36.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:36.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:36.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:36.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:37.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:37.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:37.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:37.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:38.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:38.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:38.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:38.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:39.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:39.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:39.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:39.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:40.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:40.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:40.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:40.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:41.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:41.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:41.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:41.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:42.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:42.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:42.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:42.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:43.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:43.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:43.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:43.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:44.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:44.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:44.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:44.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:45.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:45.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:45.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:45.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:46.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:46.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:46.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:46.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:47.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:47.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:47.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:47.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:48.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:48.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:48.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:48.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:49.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:49.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:49.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:49.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:50.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:50.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:50.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:50.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:51.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:51.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:51.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:51.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:52.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:52.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:53.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:53.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:53.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:53.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:54.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:54.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:54.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:54.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:54.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:54.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:55.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:55.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:56.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:56.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:56.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:56.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:57.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:57.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:57.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:57.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:58.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:58.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:58.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:58.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:59.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:56:59.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:56:59.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:56:59.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:00.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:00.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:00.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:00.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:01.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:01.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:01.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:01.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:02.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:02.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:02.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:02.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:03.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:03.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:03.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:03.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:04.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:04.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:04.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:04.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:05.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:05.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:05.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:05.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:06.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:06.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:06.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:06.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:07.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:07.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:07.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:07.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:08.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:08.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:08.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:08.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:09.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:09.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:09.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:09.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:10.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:10.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:10.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:10.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:11.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:11.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:11.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:11.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:12.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:12.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:12.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:12.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:13.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:13.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:13.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:13.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:14.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:14.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:14.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:14.060+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:15.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:15.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:15.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:15.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:16.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:16.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:16.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:16.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:17.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:17.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:17.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:17.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:18.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:18.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:18.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:18.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:19.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:19.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:19.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:19.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:20.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:20.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:20.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:20.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:21.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:21.064+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:21.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:21.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:22.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:22.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:22.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:22.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:23.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:23.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:23.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:23.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:24.068 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:24.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:24.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:24.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:25.035 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:25.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:25.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:25.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:26.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:26.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:26.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:26.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:27.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:27.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:27.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:27.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:28.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:28.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:28.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:28.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:29.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:29.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:29.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:29.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:30.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:30.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:30.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:30.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:31.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:31.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:31.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:31.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:32.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:32.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:32.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:32.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:33.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:33.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:33.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:33.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:34.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:34.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:34.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:34.396+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:35.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:35.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:35.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:35.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:36.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:36.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:36.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:36.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:37.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:37.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:37.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:37.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:38.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:38.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:38.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:38.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:39.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:39.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:39.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:39.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:40.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:40.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:40.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:40.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:41.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:41.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:41.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:41.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:42.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:42.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:42.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:42.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:43.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:43.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:43.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:43.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:44.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:44.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:44.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:44.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:45.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:45.224+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:45.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:45.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:46.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:46.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:46.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:46.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:47.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:47.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:47.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:47.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:48.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:48.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:48.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:48.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:49.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:49.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:49.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:49.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:50.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:50.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:50.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:50.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:51.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:51.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:51.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:51.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:52.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:52.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:52.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:52.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:53.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:53.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:53.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:53.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:54.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:54.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:54.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:54.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:55.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:55.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:55.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:55.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:56.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:56.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:56.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:56.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:57.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:57.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:57.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:57.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:58.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:58.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:58.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:58.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:59.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:57:59.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:57:59.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:57:59.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:00.207 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:00.199+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:00.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:00.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:01.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:01.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:01.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:01.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:02.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:02.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:02.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:02.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:03.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:03.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:03.375 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:03.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:04.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:04.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:04.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:04.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:05.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:05.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:05.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:05.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:06.216 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:06.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:06.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:06.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:07.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:07.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:07.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:07.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:08.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:08.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:08.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:08.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:09.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:09.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:09.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:09.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:10.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:10.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:10.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:10.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:11.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:11.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:11.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:11.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:12.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:12.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:12.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:12.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:13.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:13.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:13.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:13.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:14.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:14.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:14.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:14.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:15.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:15.195+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:15.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:15.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:16.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:16.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:16.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:16.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:17.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:17.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:17.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:17.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:18.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:18.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:18.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:18.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:19.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:19.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:19.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:19.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:20.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:20.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:20.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:20.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:21.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:21.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:21.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:21.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:22.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:22.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:22.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:22.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:23.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:23.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:23.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:23.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:24.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:24.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:24.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:24.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:25.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:25.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:25.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:25.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:26.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:26.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:26.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:26.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:27.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:27.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:27.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:27.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:28.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:28.243+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:28.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:28.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:29.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:29.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:29.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:29.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:30.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:30.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:30.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:30.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:31.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:31.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:31.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:31.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:32.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:32.190+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:32.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:32.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:33.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:33.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:33.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:33.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:34.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:34.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:34.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:34.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:35.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:35.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:35.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:35.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:36.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:36.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:36.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:36.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:37.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:37.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:37.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:37.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:38.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:38.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:38.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:38.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:39.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:39.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:39.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:39.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:40.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:40.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:40.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:40.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:41.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:41.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:41.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:41.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:42.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:42.322+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:42.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:42.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:43.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:43.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:43.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:43.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:44.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:44.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:44.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:44.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:45.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:45.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:45.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:45.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:46.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:46.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:46.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:46.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:47.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:47.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:47.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:47.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:48.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:48.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:48.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:48.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:49.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:49.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:49.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:49.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:50.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:50.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:50.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:50.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:51.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:51.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:51.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:51.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:52.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:52.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:52.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:52.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:53.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:53.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:53.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:53.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:54.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:54.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:54.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:54.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:55.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:55.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:55.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:55.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:56.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:56.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:56.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:56.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:57.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:57.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:57.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:57.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:58.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:58.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:58.427 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:58.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:59.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:58:59.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:58:59.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:58:59.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:00.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:00.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:00.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:00.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:01.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:01.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:01.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:01.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:02.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:02.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:02.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:02.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:03.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:03.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:03.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:03.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:04.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:04.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:04.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:04.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:05.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:05.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:05.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:05.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:06.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:06.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:06.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:06.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:07.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:07.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:07.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:07.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:08.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:08.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:08.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:08.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:09.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:09.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:09.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:09.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:10.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:10.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:10.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:10.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:11.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:11.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:11.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:11.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:12.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:12.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:12.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:12.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:13.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:13.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:13.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:13.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:14.318 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:14.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:14.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:14.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:15.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:15.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:15.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:15.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:16.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:16.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:16.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:16.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:17.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:17.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:17.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:17.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:18.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:18.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:18.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:18.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:19.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:19.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:19.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:19.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:20.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:20.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:20.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:20.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:21.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:21.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:21.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:21.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:22.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:22.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:22.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:22.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:23.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:23.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:23.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:23.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:24.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:24.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:24.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:24.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:25.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:25.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:25.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:25.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:26.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:26.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:26.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:26.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:27.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:27.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:27.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:27.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:28.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:28.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:28.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:28.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:29.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:29.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:29.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:29.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:30.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:30.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:30.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:30.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:31.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:31.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:31.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:31.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:32.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:32.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:32.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:32.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:33.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:33.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:33.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:33.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:34.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:34.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:34.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:34.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:35.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:35.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:35.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:35.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:36.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:36.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:36.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:36.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:37.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:37.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:37.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:37.589+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:38.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:38.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:38.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:38.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:39.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:39.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:39.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:39.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:40.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:40.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:40.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:40.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:41.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:41.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:41.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:41.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:42.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:42.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:42.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:42.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:43.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:43.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:43.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:43.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:44.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:44.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:44.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:44.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:45.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:45.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:45.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:45.657+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:46.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:46.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:46.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:46.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:47.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:47.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:47.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:47.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:48.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:48.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:48.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:48.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:49.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:49.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:49.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:49.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:50.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:50.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:50.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:50.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:51.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:51.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:51.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:51.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:52.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:52.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:52.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:52.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:53.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:53.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:53.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:53.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:54.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:54.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:54.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:54.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:55.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:55.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:55.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:55.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:56.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:56.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:56.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:56.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:57.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:57.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:57.782 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:57.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:58.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:58.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:58.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:58.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:59.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T06:59:59.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T06:59:59.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T06:59:59.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:00.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:00.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:00.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:00.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:01.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:01.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:01.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:01.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:02.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:02.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:02.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:02.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:03.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:03.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:03.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:03.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:04.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:04.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:04.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:04.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:05.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:05.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:05.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:05.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:06.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:06.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:06.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:06.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:07.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:07.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:07.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:07.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:08.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:08.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:08.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:08.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:09.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:09.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:09.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:09.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:10.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:10.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:10.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:10.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:11.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:11.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:11.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:11.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:12.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:12.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:12.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:12.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:13.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:13.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:13.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:13.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:14.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:14.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:14.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:14.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:15.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:15.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:15.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:15.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:16.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:16.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:16.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:16.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:17.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:17.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:17.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:17.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:18.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:18.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:18.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:18.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:19.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:19.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:19.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:19.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:20.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:20.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:20.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:20.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:21.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:21.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:21.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:21.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:22.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:22.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:22.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:22.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:23.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:23.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:23.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:23.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:24.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:24.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:24.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:24.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:25.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:25.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:25.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:25.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:26.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:26.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:26.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:26.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:27.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:27.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:27.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:27.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:28.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:28.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:28.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:28.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:29.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:29.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:29.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:29.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:30.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:30.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:30.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:30.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:31.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:31.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:31.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:31.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:32.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:32.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:32.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:32.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:33.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:33.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:33.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:33.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:34.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:34.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:34.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:34.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:35.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:35.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:35.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:35.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:36.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:36.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:36.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:36.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:37.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:37.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:37.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:37.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:38.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:38.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:38.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:38.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:39.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:39.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:39.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:39.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:40.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:40.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:40.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:40.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:41.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:41.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:41.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:41.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:42.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:42.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:42.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:42.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:43.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:43.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:43.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:43.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:44.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:44.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:44.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:44.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:45.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:45.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:45.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:45.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:46.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:46.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:46.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:46.719+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:47.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:47.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:47.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:47.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:48.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:48.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:48.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:48.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:49.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:49.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:49.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:49.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:50.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:50.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:50.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:50.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:51.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:51.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:51.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:51.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:52.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:52.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:52.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:52.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:53.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:53.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:53.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:53.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:54.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:54.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:54.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:54.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:55.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:55.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:55.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:55.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:56.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:56.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:56.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:56.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:57.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:57.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:57.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:57.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:58.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:58.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:58.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:58.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:59.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:00:59.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:00:59.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:00:59.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:00.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:00.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:00.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:00.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:01.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:01.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:01.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:01.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:02.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:02.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:02.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:02.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:03.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:03.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:03.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:03.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:04.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:04.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:04.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:04.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:05.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:05.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:05.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:05.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:06.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:06.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:06.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:06.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:07.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:07.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:07.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:07.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:08.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:08.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:08.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:08.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:09.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:09.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:09.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:09.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:10.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:10.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:10.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:10.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:11.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:11.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:11.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:11.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:12.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:12.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:12.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:12.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:13.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:13.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:13.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:13.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:14.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:14.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:14.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:14.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:15.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:15.535+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:15.578 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:15.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:16.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:16.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:16.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:16.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:17.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:17.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:17.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:17.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:18.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:18.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:18.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:18.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:19.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:19.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:19.544 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:19.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:20.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:20.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:20.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:20.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:21.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:21.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:21.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:21.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:22.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:22.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:22.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:22.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:23.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:23.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:23.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:23.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:24.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:24.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:24.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:24.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:25.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:25.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:25.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:25.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:26.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:26.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:26.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:26.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:27.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:27.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:27.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:27.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:28.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:28.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:28.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:28.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:29.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:29.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:29.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:29.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:30.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:30.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:30.686 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:30.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:31.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:31.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:31.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:31.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:32.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:32.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:32.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:32.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:33.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:33.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:33.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:33.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:34.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:34.478+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:34.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:34.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:35.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:35.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:35.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:35.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:36.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:36.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:36.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:36.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:37.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:37.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:37.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:37.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:38.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:38.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:38.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:38.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:39.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:39.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:39.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:39.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:40.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:40.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:40.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:40.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:41.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:41.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:41.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:41.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:42.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:42.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:42.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:42.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:43.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:43.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:43.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:43.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:44.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:44.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:44.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:44.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:45.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:45.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:45.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:45.810+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:46.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:46.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:46.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:46.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:47.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:47.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:47.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:47.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:48.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:48.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:48.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:48.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:49.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:49.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:49.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:49.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:50.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:50.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:50.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:50.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:51.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:51.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:51.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:51.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:52.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:52.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:52.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:52.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:53.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:53.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:53.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:53.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:54.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:54.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:54.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:54.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:55.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:55.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:55.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:55.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:56.499 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:56.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:56.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:56.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:57.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:57.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:57.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:57.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:58.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:58.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:58.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:58.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:59.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:01:59.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:01:59.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:01:59.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:00.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:00.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:00.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:00.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:01.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:01.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:01.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:01.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:02.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:02.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:02.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:02.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:03.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:03.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:03.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:03.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:04.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:04.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:04.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:04.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:05.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:05.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:05.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:05.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:06.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:06.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:06.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:06.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:07.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:07.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:07.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:07.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:08.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:08.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:08.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:08.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:09.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:09.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:09.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:09.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:10.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:10.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:10.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:10.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:11.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:11.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:11.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:11.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:12.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:12.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:12.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:12.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:13.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:13.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:13.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:13.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:14.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:14.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:14.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:14.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:15.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:15.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:15.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:15.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:16.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:16.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:16.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:16.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:17.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:17.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:17.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:17.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:18.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:18.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:18.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:18.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:19.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:19.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:19.871 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:19.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:20.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:20.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:20.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:20.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:21.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:21.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:21.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:21.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:22.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:22.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:22.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:22.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:23.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:23.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:23.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:23.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:24.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:24.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:24.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:24.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:25.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:25.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:25.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:25.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:26.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:26.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:26.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:26.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:27.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:27.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:27.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:27.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:28.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:28.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:28.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:28.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:29.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:29.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:29.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:29.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:30.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:30.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:30.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:30.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:31.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:31.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:31.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:31.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:32.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:32.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:32.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:32.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:33.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:33.717+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:33.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:33.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:34.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:34.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:34.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:34.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:35.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:35.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:35.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:35.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:36.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:36.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:36.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:36.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:37.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:37.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:37.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:37.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:38.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:38.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:38.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:39.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:39.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:39.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:39.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:40.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:40.765+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:40.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:40.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:41.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:41.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:41.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:41.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:42.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:42.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:42.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:42.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:43.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:43.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:43.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:43.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:44.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:44.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:44.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:44.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:45.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:45.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:45.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:45.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:46.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:46.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:46.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:46.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:47.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:47.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:47.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:47.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:48.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:48.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:48.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:48.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:49.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:49.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:49.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:49.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:50.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:50.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:50.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:50.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:51.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:51.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:51.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:51.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:52.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:52.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:52.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:52.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:53.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:53.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:53.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:53.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:54.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:54.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:54.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:54.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:55.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:55.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:55.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:55.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:56.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:56.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:56.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:56.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:57.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:57.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:57.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:57.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:58.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:58.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:58.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:58.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:59.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:02:59.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:02:59.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:02:59.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:00.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:00.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:00.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:00.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:01.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:01.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:01.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:01.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:02.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:02.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:02.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:02.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:03.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:03.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:03.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:03.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:04.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:04.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:04.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:04.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:05.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:05.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:05.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:05.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:06.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:06.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:06.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:06.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:07.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:07.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:07.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:07.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:08.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:08.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:08.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:08.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:09.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:09.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:09.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:09.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:10.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:10.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:11.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:11.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:11.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:11.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:12.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:12.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:12.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:12.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:12.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:12.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:13.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:13.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:14.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:14.004+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:14.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:14.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:14.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:14.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:15.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:15.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:16.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:16.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:16.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:16.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:16.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:16.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:17.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:17.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:17.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:17.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:18.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:18.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:19.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:19.008+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:19.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:19.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:19.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:19.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:20.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:20.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:20.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:20.992+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:21.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:21.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:21.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:21.956+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:22.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:22.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:22.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:22.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:23.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:23.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:23.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:23.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:24.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:24.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:24.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:24.920+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:25.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:25.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:25.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:25.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:26.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:26.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:26.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:26.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:27.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:27.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:27.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:27.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:28.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:28.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:28.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:28.807+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:29.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:29.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:29.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:29.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:30.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:30.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:30.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:30.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:31.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:31.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:31.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:31.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:32.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:32.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:32.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:32.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:33.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:33.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:33.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:33.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:34.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:34.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:34.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:34.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:35.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:35.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:35.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:35.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:36.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:36.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:36.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:36.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:37.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:37.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:37.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:37.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:38.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:38.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:38.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:38.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:39.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:39.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:39.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:39.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:40.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:40.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:40.936 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:40.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:41.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:41.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:41.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:41.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:42.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:42.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:42.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:42.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:43.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:43.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:43.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:43.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:44.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:44.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:44.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:44.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:45.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:45.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:45.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:45.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:46.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:46.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:46.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:46.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:47.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:47.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:47.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:47.847+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:48.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:48.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:48.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:48.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:49.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:49.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:49.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:49.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:50.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:50.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:50.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:50.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:51.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:51.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:51.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:51.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:52.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:52.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:52.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:52.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:53.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:53.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:53.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:53.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:54.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:54.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:54.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:54.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:55.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:55.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:55.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:55.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:56.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:56.567+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:56.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:56.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:57.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:57.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:57.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:57.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:58.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:58.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:58.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:58.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:59.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:03:59.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:03:59.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:03:59.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:00.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:00.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:00.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:00.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:01.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:01.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:01.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:01.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:02.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:02.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:02.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:02.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:03.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:03.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:03.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:03.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:04.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:04.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:04.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:04.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:05.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:05.455+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:05.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:05.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:06.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:06.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:06.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:06.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:07.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:07.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:07.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:07.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:08.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:08.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:08.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:08.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:09.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:09.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:09.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:09.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:10.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:10.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:10.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:10.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:11.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:11.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:11.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:11.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:12.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:12.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:12.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:12.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:13.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:13.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:13.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:13.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:14.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:14.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:14.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:14.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:15.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:15.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:15.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:15.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:16.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:16.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:16.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:16.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:17.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:17.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:17.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:17.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:18.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:18.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:18.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:18.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:19.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:19.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:19.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:19.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:20.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:20.510+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:20.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:20.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:21.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:21.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:21.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:21.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:22.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:22.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:22.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:22.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:23.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:23.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:23.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:23.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:24.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:24.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:24.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:24.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:25.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:25.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:25.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:25.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:26.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:26.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:26.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:26.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:27.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:27.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:27.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:27.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:28.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:28.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:28.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:28.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:29.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:29.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:29.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:29.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:30.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:30.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:30.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:30.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:31.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:31.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:31.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:31.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:32.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:32.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:32.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:32.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:33.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:33.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:33.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:33.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:34.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:34.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:34.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:34.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:35.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:35.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:35.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:35.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:36.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:36.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:36.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:36.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:37.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:37.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:37.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:37.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:38.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:38.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:38.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:38.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:39.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:39.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:39.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:39.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:40.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:40.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:40.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:40.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:41.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:41.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:41.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:41.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:42.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:42.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:42.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:42.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:43.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:43.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:43.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:43.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:44.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:44.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:44.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:44.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:45.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:45.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:45.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:45.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:46.581 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:46.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:46.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:46.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:47.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:47.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:47.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:47.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:48.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:48.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:48.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:48.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:49.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:49.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:49.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:49.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:50.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:50.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:50.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:50.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:51.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:51.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:51.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:51.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:52.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:52.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:52.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:52.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:53.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:53.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:53.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:53.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:54.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:54.573+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:54.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:54.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:55.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:55.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:55.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:55.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:56.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:56.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:56.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:56.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:57.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:57.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:57.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:57.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:58.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:58.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:58.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:58.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:59.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:04:59.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:04:59.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:04:59.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:00.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:00.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:00.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:00.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:01.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:01.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:01.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:01.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:02.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:02.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:02.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:02.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:03.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:03.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:03.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:03.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:04.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:04.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:04.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:04.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:05.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:05.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:05.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:05.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:06.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:06.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:06.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:06.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:07.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:07.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:07.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:07.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:08.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:08.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:08.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:08.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:09.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:09.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:09.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:09.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:10.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:10.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:10.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:10.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:11.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:11.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:11.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:11.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:12.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:12.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:12.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:12.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:13.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:13.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:13.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:13.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:14.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:14.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:14.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:14.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:15.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:15.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:15.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:15.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:16.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:16.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:16.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:16.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:17.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:17.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:17.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:17.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:18.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:18.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:18.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:18.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:19.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:19.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:19.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:19.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:20.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:20.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:20.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:20.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:21.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:21.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:21.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:21.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:22.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:22.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:22.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:22.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:23.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:23.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:23.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:23.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:24.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:24.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:24.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:24.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:25.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:25.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:25.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:25.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:26.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:26.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:26.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:26.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:27.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:27.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:27.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:27.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:28.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:28.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:28.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:28.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:29.512 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:29.505+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:29.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:29.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:30.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:30.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:30.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:30.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:31.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:31.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:31.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:31.761+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:32.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:32.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:32.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:32.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:33.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:33.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:33.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:33.784+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:34.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:34.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:34.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:34.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:35.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:35.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:35.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:35.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:36.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:36.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:36.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:36.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:37.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:37.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:37.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:37.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:38.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:38.472+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:38.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:38.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:39.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:39.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:39.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:39.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:40.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:40.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:40.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:40.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:41.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:41.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:41.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:41.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:42.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:42.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:42.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:42.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:43.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:43.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:43.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:43.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:44.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:44.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:44.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:44.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:45.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:45.460+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:45.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:45.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:46.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:46.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:46.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:46.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:47.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:47.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:47.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:47.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:48.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:48.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:48.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:48.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:49.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:49.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:49.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:49.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:50.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:50.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:50.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:50.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:51.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:51.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:51.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:51.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:52.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:52.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:52.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:52.560+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:53.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:53.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:53.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:53.596+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:54.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:54.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:54.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:54.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:55.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:55.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:55.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:55.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:56.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:56.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:56.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:56.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:57.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:57.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:57.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:57.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:58.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:58.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:58.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:58.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:59.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:05:59.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:05:59.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:05:59.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:00.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:00.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:00.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:00.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:01.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:01.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:01.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:01.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:02.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:02.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:02.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:02.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:03.511 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:03.504+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:03.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:03.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:04.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:04.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:04.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:04.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:05.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:05.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:05.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:05.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:06.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:06.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:06.527 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:06.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:07.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:07.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:07.503 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:07.496+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:08.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:08.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:08.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:08.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:09.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:09.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:09.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:09.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:10.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:10.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:10.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:10.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:11.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:11.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:11.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:11.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:12.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:12.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:12.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:12.584+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:13.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:13.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:13.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:13.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:14.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:14.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:14.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:14.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:15.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:15.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:15.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:15.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:16.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:16.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:16.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:16.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:17.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:17.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:17.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:17.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:18.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:18.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:18.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:18.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:19.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:19.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:19.658 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:19.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:20.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:20.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:20.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:20.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:21.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:21.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:21.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:21.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:22.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:22.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:22.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:22.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:23.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:23.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:23.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:23.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:24.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:24.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:24.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:24.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:25.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:25.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:25.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:25.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:26.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:26.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:26.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:26.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:27.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:27.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:27.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:27.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:28.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:28.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:28.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:28.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:29.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:29.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:29.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:29.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:30.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:30.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:30.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:30.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:31.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:31.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:31.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:31.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:32.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:32.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:32.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:32.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:33.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:33.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:33.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:33.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:34.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:34.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:34.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:34.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:35.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:35.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:35.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:35.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:36.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:36.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:36.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:36.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:37.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:37.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:37.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:37.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:38.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:38.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:38.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:38.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:39.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:39.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:39.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:39.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:40.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:40.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:40.706 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:40.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:41.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:41.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:41.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:41.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:42.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:42.183+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:42.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:42.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:43.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:43.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:43.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:43.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:44.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:44.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:44.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:44.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:45.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:45.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:45.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:45.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:46.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:46.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:46.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:46.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:47.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:47.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:47.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:47.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:48.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:48.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:48.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:48.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:49.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:49.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:49.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:49.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:50.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:50.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:50.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:50.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:51.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:51.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:51.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:51.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:52.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:52.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:52.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:52.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:53.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:53.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:53.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:53.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:54.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:54.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:54.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:54.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:55.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:55.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:55.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:55.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:56.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:56.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:56.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:56.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:57.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:57.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:57.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:57.755+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:57.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:57.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:58.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:58.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:58.961 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:58.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:59.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:06:59.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:06:59.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:06:59.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:00.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:00.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:00.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:00.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:01.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:01.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:01.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:01.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:02.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:02.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:02.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:02.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:03.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:03.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:04.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:03.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:04.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:04.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:05.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:05.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:05.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:05.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:05.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:05.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:06.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:06.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:07.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:07.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:07.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:07.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:08.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:08.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:08.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:08.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:09.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:09.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:09.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:09.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:10.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:09.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:10.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:10.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:11.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:11.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:11.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:11.738+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:11.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:11.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:12.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:12.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:12.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:12.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:13.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:13.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:13.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:13.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:14.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:14.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:14.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:14.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:15.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:15.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:16.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:16.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:16.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:16.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:17.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:16.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:17.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:17.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:18.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:18.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:18.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:18.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:19.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:19.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:19.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:19.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:20.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:19.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:20.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:20.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:20.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:20.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:21.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:21.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:21.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:21.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:22.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:22.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:22.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:22.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:23.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:23.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:23.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:23.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:24.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:24.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:24.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:24.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:25.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:25.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:25.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:25.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:26.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:26.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:26.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:26.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:27.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:27.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:27.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:27.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:28.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:28.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:29.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:29.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:29.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:29.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:30.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:29.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:30.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:30.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:31.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:31.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:31.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:31.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:32.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:32.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:32.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:32.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:33.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:33.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:33.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:33.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:34.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:34.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:34.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:34.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:35.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:35.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:35.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:35.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:36.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:36.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:36.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:36.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:37.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:37.122+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:37.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:37.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:38.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:38.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:38.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:38.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:39.196 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:39.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:39.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:39.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:40.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:40.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:40.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:40.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:41.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:41.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:41.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:41.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:42.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:42.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:42.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:42.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:43.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:43.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:43.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:43.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:44.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:44.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:44.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:44.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:45.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:45.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:45.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:45.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:46.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:46.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:46.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:46.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:47.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:47.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:47.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:47.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:48.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:48.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:48.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:48.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:49.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:49.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:49.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:49.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:50.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:50.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:50.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:50.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:51.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:51.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:51.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:51.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:52.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:52.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:52.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:52.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:53.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:53.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:53.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:53.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:54.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:54.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:54.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:54.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:55.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:55.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:55.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:55.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:56.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:56.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:56.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:56.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:57.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:57.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:57.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:57.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:58.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:58.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:58.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:58.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:59.256 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:07:59.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:07:59.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:07:59.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:00.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:00.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:00.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:00.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:01.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:01.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:01.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:01.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:02.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:02.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:02.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:02.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:03.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:03.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:03.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:03.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:04.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:04.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:04.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:04.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:05.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:05.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:05.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:05.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:06.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:06.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:06.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:06.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:07.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:07.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:07.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:07.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:08.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:08.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:08.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:08.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:09.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:09.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:09.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:09.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:10.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:10.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:10.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:10.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:11.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:11.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:11.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:11.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:12.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:12.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:12.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:12.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:13.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:13.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:13.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:13.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:14.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:14.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:14.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:14.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:15.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:15.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:15.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:15.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:16.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:16.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:16.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:16.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:17.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:17.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:17.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:17.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:18.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:18.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:18.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:18.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:19.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:19.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:19.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:19.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:20.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:20.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:20.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:20.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:21.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:21.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:21.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:21.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:22.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:22.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:22.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:22.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:23.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:23.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:23.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:23.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:24.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:24.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:24.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:24.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:25.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:25.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:25.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:25.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:26.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:26.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:26.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:26.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:27.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:27.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:27.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:27.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:28.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:28.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:28.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:28.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:29.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:29.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:29.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:29.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:30.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:30.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:30.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:30.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:31.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:31.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:31.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:31.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:32.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:32.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:32.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:32.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:33.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:33.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:33.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:33.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:34.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:34.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:34.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:34.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:35.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:35.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:35.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:35.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:36.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:36.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:36.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:36.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:37.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:37.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:37.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:37.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:38.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:38.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:38.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:38.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:39.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:39.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:39.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:39.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:40.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:40.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:40.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:40.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:41.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:41.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:41.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:41.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:42.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:42.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:42.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:42.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:43.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:43.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:43.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:43.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:44.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:44.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:44.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:44.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:45.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:45.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:45.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:45.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:46.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:46.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:46.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:46.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:47.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:47.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:47.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:47.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:48.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:48.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:48.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:48.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:49.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:49.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:49.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:49.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:50.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:50.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:50.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:50.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:51.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:51.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:51.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:51.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:52.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:52.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:52.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:52.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:53.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:53.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:53.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:53.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:54.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:54.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:54.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:54.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:55.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:55.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:55.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:55.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:56.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:56.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:56.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:56.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:57.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:57.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:57.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:57.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:58.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:58.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:58.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:58.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:59.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:08:59.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:08:59.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:08:59.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:00.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:00.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:00.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:00.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:01.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:01.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:01.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:01.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:02.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:02.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:02.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:02.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:03.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:03.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:03.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:03.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:04.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:04.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:04.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:04.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:05.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:05.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:05.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:05.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:06.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:06.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:06.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:06.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:07.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:07.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:07.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:07.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:08.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:08.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:08.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:08.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:09.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:09.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:09.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:09.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:10.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:10.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:10.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:10.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:11.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:11.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:11.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:11.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:12.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:12.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:12.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:12.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:13.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:13.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:13.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:13.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:14.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:14.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:14.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:14.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:15.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:15.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:15.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:15.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:16.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:16.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:16.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:16.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:17.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:17.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:17.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:17.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:18.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:18.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:18.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:18.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:19.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:19.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:19.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:19.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:20.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:20.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:21.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:21.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:21.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:21.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:21.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:21.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:22.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:22.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:22.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:22.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:23.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:23.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:23.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:23.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:24.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:24.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:24.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:24.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:25.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:25.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:25.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:25.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:26.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:26.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:27.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:27.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:27.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:27.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:28.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:27.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:28.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:28.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:28.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:28.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:29.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:29.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:29.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:29.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:30.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:30.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:30.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:30.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:31.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:31.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:31.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:31.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:32.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:32.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:32.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:32.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:33.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:33.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:33.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:33.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:34.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:34.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:34.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:34.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:35.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:35.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:35.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:35.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:36.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:36.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:36.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:36.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:37.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:37.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:37.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:37.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:38.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:38.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:38.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:38.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:39.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:39.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:39.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:39.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:40.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:40.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:40.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:40.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:41.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:41.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:41.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:41.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:42.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:42.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:42.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:42.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:43.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:43.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:43.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:43.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:44.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:44.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:44.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:44.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:45.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:45.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:45.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:45.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:46.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:46.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:46.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:46.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:47.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:47.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:48.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:48.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:48.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:48.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:49.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:49.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:49.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:49.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:50.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:50.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:50.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:50.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:51.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:51.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:51.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:51.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:52.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:52.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:52.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:52.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:53.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:53.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:53.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:53.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:54.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:54.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:54.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:54.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:55.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:55.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:55.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:55.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:56.004 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:55.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:56.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:56.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:56.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:56.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:57.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:57.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:57.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:57.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:58.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:58.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:58.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:58.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:59.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:09:59.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:09:59.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:09:59.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:00.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:00.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:01.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:00.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:01.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:01.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:01.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:01.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:02.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:02.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:02.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:02.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:03.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:03.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:03.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:03.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:04.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:04.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:04.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:04.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:05.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:05.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:05.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:05.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:06.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:06.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:06.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:06.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:07.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:07.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:07.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:07.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:08.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:08.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:08.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:08.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:09.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:09.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:09.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:09.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:10.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:10.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:11.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:11.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:11.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:11.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:12.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:12.050+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:12.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:12.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:13.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:13.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:13.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:13.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:14.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:14.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:14.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:14.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:15.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:15.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:15.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:15.642+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:16.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:16.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:16.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:16.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:17.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:16.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:17.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:17.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:17.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:17.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:18.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:18.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:18.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:18.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:19.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:19.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:19.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:19.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:20.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:20.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:21.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:20.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:21.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:21.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:21.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:21.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:22.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:22.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:23.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:22.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:23.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:23.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:24.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:24.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:24.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:24.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:25.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:25.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:25.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:25.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:26.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:26.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:26.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:26.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:27.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:27.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:27.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:27.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:28.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:28.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:28.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:28.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:29.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:29.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:29.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:29.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:30.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:30.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:30.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:30.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:31.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:30.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:31.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:31.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:32.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:32.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:32.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:32.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:33.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:33.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:33.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:33.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:34.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:34.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:34.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:34.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:35.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:35.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:35.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:35.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:36.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:36.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:36.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:36.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:37.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:37.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:37.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:37.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:38.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:38.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:38.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:39.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:39.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:39.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:39.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:40.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:40.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:40.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:40.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:41.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:41.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:41.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:41.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:42.068 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:42.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:42.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:42.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:43.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:43.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:43.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:43.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:44.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:44.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:44.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:44.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:45.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:45.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:45.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:45.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:46.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:46.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:46.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:46.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:47.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:47.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:47.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:47.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:48.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:48.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:48.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:48.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:49.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:49.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:49.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:49.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:50.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:50.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:50.692 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:50.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:50.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:50.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:51.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:51.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:51.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:51.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:52.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:52.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:52.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:52.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:53.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:53.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:53.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:53.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:54.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:54.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:54.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:54.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:55.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:55.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:55.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:55.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:56.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:56.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:56.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:56.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:57.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:57.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:57.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:57.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:58.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:58.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:58.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:58.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:59.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:10:59.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:10:59.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:10:59.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:00.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:00.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:00.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:00.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:01.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:01.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:01.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:01.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:02.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:02.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:02.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:02.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:03.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:03.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:03.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:03.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:04.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:04.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:04.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:04.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:05.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:05.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:06.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:06.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:06.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:06.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:07.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:07.021+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:07.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:07.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:08.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:08.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:08.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:08.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:09.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:08.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:09.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:09.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:10.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:10.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:10.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:10.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:11.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:11.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:11.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:11.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:12.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:12.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:12.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:12.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:13.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:13.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:13.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:13.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:14.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:14.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:14.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:14.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:15.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:15.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:15.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:15.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:16.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:16.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:16.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:16.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:16.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:16.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:17.715 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:17.708+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:17.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:17.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:18.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:18.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:18.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:18.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:19.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:19.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:19.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:19.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:20.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:20.704+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:20.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:20.920+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:21.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:21.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:21.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:21.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:22.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:22.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:22.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:22.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:23.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:23.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:23.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:23.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:24.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:24.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:24.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:24.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:25.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:25.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:25.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:25.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:26.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:26.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:26.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:26.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:27.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:27.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:27.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:27.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:28.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:28.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:28.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:28.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:29.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:29.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:29.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:29.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:30.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:30.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:30.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:30.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:31.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:31.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:31.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:31.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:32.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:32.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:32.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:33.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:33.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:33.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:33.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:34.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:34.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:34.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:34.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:35.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:35.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:35.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:35.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:36.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:36.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:36.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:36.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:37.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:37.764+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:37.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:37.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:38.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:38.772+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:38.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:38.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:39.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:39.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:39.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:39.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:40.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:40.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:40.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:40.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:41.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:41.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:41.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:41.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:42.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:42.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:42.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:42.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:43.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:43.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:43.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:43.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:44.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:44.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:44.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:44.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:45.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:45.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:45.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:45.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:46.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:46.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:46.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:46.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:47.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:47.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:47.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:47.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:48.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:48.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:48.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:48.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:49.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:49.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:49.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:49.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:50.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:50.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:50.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:50.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:51.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:51.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:51.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:51.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:52.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:52.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:52.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:52.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:53.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:53.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:53.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:53.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:54.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:54.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:54.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:54.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:55.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:55.711+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:55.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:55.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:56.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:56.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:56.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:56.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:57.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:57.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:57.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:57.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:58.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:58.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:58.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:58.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:59.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:11:59.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:11:59.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:11:59.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:00.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:00.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:00.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:00.771+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:01.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:01.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:01.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:01.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:02.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:02.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:02.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:02.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:03.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:03.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:03.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:03.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:04.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:04.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:04.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:04.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:05.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:05.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:05.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:05.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:06.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:06.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:06.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:06.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:07.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:07.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:07.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:07.727+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:08.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:08.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:08.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:08.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:09.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:09.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:09.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:09.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:10.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:10.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:10.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:10.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:11.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:11.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:11.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:11.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:12.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:12.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:12.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:12.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:13.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:13.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:13.708 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:13.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:14.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:14.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:14.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:14.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:15.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:15.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:15.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:15.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:16.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:16.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:16.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:16.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:17.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:17.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:17.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:17.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:18.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:18.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:18.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:18.723+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:19.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:19.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:19.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:19.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:20.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:20.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:20.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:20.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:21.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:21.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:21.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:21.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:22.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:22.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:22.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:22.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:23.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:23.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:23.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:23.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:24.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:24.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:24.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:24.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:25.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:25.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:25.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:25.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:26.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:26.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:26.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:26.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:27.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:27.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:27.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:27.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:28.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:28.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:28.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:28.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:29.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:29.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:29.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:29.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:30.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:30.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:30.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:30.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:31.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:31.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:31.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:31.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:32.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:32.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:32.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:32.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:33.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:33.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:33.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:33.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:34.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:34.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:34.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:34.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:35.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:35.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:35.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:35.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:36.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:36.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:36.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:36.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:37.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:37.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:37.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:37.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:38.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:38.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:38.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:38.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:39.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:39.514+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:39.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:39.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:40.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:40.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:40.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:40.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:41.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:41.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:41.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:41.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:42.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:42.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:42.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:42.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:43.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:43.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:43.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:43.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:44.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:44.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:44.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:44.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:45.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:45.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:45.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:45.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:46.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:46.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:46.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:46.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:47.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:47.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:47.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:47.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:48.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:48.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:48.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:48.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:49.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:49.558+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:49.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:49.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:50.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:50.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:50.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:50.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:51.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:51.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:51.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:51.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:52.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:52.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:52.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:52.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:53.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:53.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:53.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:53.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:54.591 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:54.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:54.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:54.790+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:55.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:55.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:55.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:55.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:56.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:56.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:56.729 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:56.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:57.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:57.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:57.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:57.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:58.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:58.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:58.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:58.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:59.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:12:59.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:12:59.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:12:59.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:00.626 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:00.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:00.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:00.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:01.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:01.574+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:01.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:01.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:02.588 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:02.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:02.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:02.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:03.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:03.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:03.631 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:03.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:04.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:04.554+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:04.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:04.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:05.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:05.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:05.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:05.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:06.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:06.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:06.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:06.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:07.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:07.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:07.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:07.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:08.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:08.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:08.596 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:08.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:09.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:09.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:09.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:09.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:10.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:10.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:10.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:10.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:11.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:11.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:11.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:11.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:12.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:12.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:12.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:12.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:13.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:13.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:13.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:13.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:14.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:14.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:14.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:14.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:15.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:15.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:15.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:15.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:16.609 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:16.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:16.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:16.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:17.567 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:17.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:17.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:17.574+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:18.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:18.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:18.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:19.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:19.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:19.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:19.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:20.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:20.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:20.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:20.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:21.547 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:21.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:21.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:21.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:22.543 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:22.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:22.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:22.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:23.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:23.573+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:23.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:23.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:24.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:24.557+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:24.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:24.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:25.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:25.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:25.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:25.629+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:26.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:26.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:26.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:26.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:27.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:27.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:27.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:27.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:28.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:28.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:28.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:28.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:29.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:29.465+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:29.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:29.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:30.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:30.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:30.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:30.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:31.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:31.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:31.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:31.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:32.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:32.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:32.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:32.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:33.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:33.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:33.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:33.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:34.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:34.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:34.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:34.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:35.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:35.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:35.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:35.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:36.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:36.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:36.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:36.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:37.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:37.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:37.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:37.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:38.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:38.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:38.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:38.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:39.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:39.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:39.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:39.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:40.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:40.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:40.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:40.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:41.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:41.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:41.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:41.601+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:42.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:42.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:42.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:42.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:43.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:43.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:43.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:43.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:44.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:44.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:44.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:44.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:45.549 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:45.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:45.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:45.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:46.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:46.593+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:46.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:46.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:47.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:47.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:47.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:47.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:48.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:48.585+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:48.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:48.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:49.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:49.553+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:49.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:49.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:50.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:50.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:50.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:50.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:51.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:51.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:51.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:51.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:52.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:52.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:52.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:52.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:53.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:53.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:53.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:53.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:54.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:54.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:54.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:54.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:55.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:55.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:55.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:55.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:56.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:56.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:56.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:56.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:57.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:57.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:57.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:57.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:58.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:58.565+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:58.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:58.677+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:59.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:13:59.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:13:59.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:13:59.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:00.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:00.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:00.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:00.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:01.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:01.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:01.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:01.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:02.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:02.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:02.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:02.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:03.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:03.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:03.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:03.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:04.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:04.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:04.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:04.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:05.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:05.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:05.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:05.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:06.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:06.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:06.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:06.616+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:07.587 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:07.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:07.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:07.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:08.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:08.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:08.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:08.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:09.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:09.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:09.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:09.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:10.580 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:10.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:10.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:10.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:11.574 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:11.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:11.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:11.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:12.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:12.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:12.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:12.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:13.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:13.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:13.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:13.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:14.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:14.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:14.641 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:14.632+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:15.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:15.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:15.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:15.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:16.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:16.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:16.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:16.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:17.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:17.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:17.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:17.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:18.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:18.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:18.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:18.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:19.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:19.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:19.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:19.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:20.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:20.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:20.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:20.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:21.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:21.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:21.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:21.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:22.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:22.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:22.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:22.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:23.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:23.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:23.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:23.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:24.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:24.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:24.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:24.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:25.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:25.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:25.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:25.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:26.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:26.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:26.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:26.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:27.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:27.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:27.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:27.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:28.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:28.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:28.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:28.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:29.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:29.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:29.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:29.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:30.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:30.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:30.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:30.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:31.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:31.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:31.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:31.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:32.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:32.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:32.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:32.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:33.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:33.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:33.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:33.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:34.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:34.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:34.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:34.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:35.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:35.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:35.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:35.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:36.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:36.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:36.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:36.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:37.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:37.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:37.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:37.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:38.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:38.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:38.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:38.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:39.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:39.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:39.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:39.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:40.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:40.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:40.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:40.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:41.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:41.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:41.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:41.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:42.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:42.460+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:42.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:42.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:43.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:43.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:43.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:43.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:44.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:44.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:44.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:44.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:45.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:45.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:45.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:45.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:46.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:46.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:46.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:46.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:47.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:47.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:47.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:47.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:48.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:48.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:48.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:48.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:49.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:49.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:49.823 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:49.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:50.311 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:50.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:50.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:50.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:51.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:51.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:51.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:51.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:52.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:52.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:52.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:52.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:53.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:53.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:53.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:53.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:54.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:54.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:54.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:54.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:55.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:55.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:55.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:55.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:56.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:56.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:56.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:56.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:57.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:57.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:57.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:57.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:58.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:58.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:58.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:58.855+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:59.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:14:59.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:14:59.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:14:59.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:00.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:00.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:00.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:00.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:01.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:01.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:01.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:01.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:02.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:02.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:02.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:02.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:03.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:03.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:03.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:03.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:04.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:04.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:04.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:04.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:05.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:05.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:05.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:05.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:06.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:06.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:06.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:06.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:07.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:07.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:07.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:07.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:08.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:08.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:08.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:08.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:09.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:09.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:09.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:09.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:10.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:10.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:10.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:10.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:11.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:11.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:12.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:11.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:12.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:12.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:13.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:12.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:13.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:13.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:13.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:13.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:14.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:14.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:15.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:15.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:15.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:15.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:15.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:15.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:16.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:16.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:16.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:16.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:17.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:17.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:17.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:17.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:18.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:18.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:19.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:19.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:19.274 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:19.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:20.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:20.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:20.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:20.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:21.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:20.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:21.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:21.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:22.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:22.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:22.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:22.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:23.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:23.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:23.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:23.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:24.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:24.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:24.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:24.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:25.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:25.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:25.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:25.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:26.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:26.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:26.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:26.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:27.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:27.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:27.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:27.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:28.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:28.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:28.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:28.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:29.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:29.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:29.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:29.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:30.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:30.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:30.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:30.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:31.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:31.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:31.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:31.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:32.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:32.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:32.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:32.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:33.193 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:33.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:33.368 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:33.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:34.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:34.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:34.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:34.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:35.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:35.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:35.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:35.402+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:36.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:36.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:36.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:36.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:37.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:37.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:37.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:37.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:38.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:38.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:38.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:38.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:39.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:39.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:39.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:39.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:40.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:40.218+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:40.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:40.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:41.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:41.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:41.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:41.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:42.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:42.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:42.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:42.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:43.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:43.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:43.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:43.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:44.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:44.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:44.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:44.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:45.118 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:45.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:45.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:45.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:46.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:46.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:46.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:46.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:47.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:47.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:47.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:47.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:48.098 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:48.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:48.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:48.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:49.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:49.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:49.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:49.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:50.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:50.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:50.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:50.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:51.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:51.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:51.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:51.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:52.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:52.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:52.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:52.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:53.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:53.174+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:53.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:53.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:54.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:54.178+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:54.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:54.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:55.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:55.222+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:55.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:55.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:56.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:56.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:56.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:56.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:57.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:57.210+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:57.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:57.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:58.206 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:58.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:58.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:58.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:59.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:15:59.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:15:59.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:15:59.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:00.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:00.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:00.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:00.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:01.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:01.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:01.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:01.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:02.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:02.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:02.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:02.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:03.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:03.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:03.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:03.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:04.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:04.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:04.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:04.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:05.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:05.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:05.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:05.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:06.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:06.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:06.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:06.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:07.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:07.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:07.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:07.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:08.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:08.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:08.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:08.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:09.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:09.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:09.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:09.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:10.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:10.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:10.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:10.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:11.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:11.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:11.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:11.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:12.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:12.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:12.311 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:12.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:13.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:13.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:13.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:13.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:14.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:14.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:14.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:14.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:15.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:15.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:15.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:15.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:16.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:16.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:16.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:16.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:17.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:17.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:17.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:17.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:18.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:18.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:18.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:18.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:19.128 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:19.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:19.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:19.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:20.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:20.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:20.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:20.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:21.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:21.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:21.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:21.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:22.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:22.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:22.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:22.545+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:23.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:23.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:23.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:23.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:24.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:24.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:24.506 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:24.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:25.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:25.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:25.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:25.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:26.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:26.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:26.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:26.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:27.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:27.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:27.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:27.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:28.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:28.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:28.476 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:28.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:29.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:29.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:29.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:29.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:30.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:30.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:30.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:30.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:31.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:31.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:31.489 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:31.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:32.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:32.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:32.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:32.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:33.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:33.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:33.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:33.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:34.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:34.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:34.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:34.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:35.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:35.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:35.555 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:35.549+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:36.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:36.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:36.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:36.561+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:37.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:37.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:37.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:37.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:38.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:38.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:38.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:38.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:39.269 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:39.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:39.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:39.649+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:40.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:40.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:40.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:40.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:41.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:41.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:41.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:41.581+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:42.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:42.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:42.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:42.597+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:43.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:43.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:43.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:43.609+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:44.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:44.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:44.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:44.625+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:45.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:45.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:45.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:45.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:46.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:46.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:46.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:46.633+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:47.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:47.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:47.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:47.621+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:48.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:48.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:48.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:48.673+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:49.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:49.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:49.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:49.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:50.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:50.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:50.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:50.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:51.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:51.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:51.612 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:51.604+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:52.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:52.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:52.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:52.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:53.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:53.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:53.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:53.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:54.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:54.220+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:54.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:54.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:55.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:55.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:55.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:55.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:56.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:56.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:56.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:56.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:57.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:57.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:57.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:57.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:58.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:58.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:58.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:58.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:59.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:16:59.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:16:59.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:16:59.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:00.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:00.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:00.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:00.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:01.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:01.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:01.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:01.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:02.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:02.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:02.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:02.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:03.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:03.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:03.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:03.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:04.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:04.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:04.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:04.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:05.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:05.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:05.659 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:05.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:06.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:06.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:06.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:06.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:07.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:07.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:07.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:07.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:08.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:08.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:08.664 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:08.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:09.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:09.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:09.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:09.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:10.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:10.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:10.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:10.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:11.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:11.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:11.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:11.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:12.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:12.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:12.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:12.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:13.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:13.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:13.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:13.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:14.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:14.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:14.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:14.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:15.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:15.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:15.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:15.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:16.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:16.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:16.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:16.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:17.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:17.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:17.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:17.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:18.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:18.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:18.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:18.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:19.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:19.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:19.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:19.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:20.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:20.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:20.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:20.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:21.512 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:21.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:21.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:21.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:22.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:22.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:22.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:22.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:23.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:23.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:23.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:23.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:24.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:24.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:24.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:24.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:25.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:25.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:26.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:26.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:26.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:26.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:26.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:26.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:27.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:27.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:27.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:27.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:28.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:28.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:28.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:28.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:29.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:29.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:29.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:29.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:30.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:30.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:30.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:30.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:31.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:31.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:31.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:31.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:32.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:32.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:32.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:32.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:33.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:33.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:34.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:34.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:34.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:34.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:34.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:34.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:35.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:35.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:35.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:35.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:36.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:36.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:36.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:36.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:37.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:37.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:37.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:37.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:38.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:38.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:38.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:38.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:39.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:39.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:39.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:39.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:40.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:40.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:40.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:40.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:41.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:41.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:41.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:41.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:42.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:42.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:42.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:42.883+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:43.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:43.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:43.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:43.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:44.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:44.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:44.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:44.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:45.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:45.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:45.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:45.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:46.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:46.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:46.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:46.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:47.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:47.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:47.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:47.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:48.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:48.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:48.935 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:48.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:49.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:49.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:49.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:49.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:50.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:50.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:50.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:50.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:51.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:51.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:51.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:51.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:52.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:52.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:52.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:52.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:53.142 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:53.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:53.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:53.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:54.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:54.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:54.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:54.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:55.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:55.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:55.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:55.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:56.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:56.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:56.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:56.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:57.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:57.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:57.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:57.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:58.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:58.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:58.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:58.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:59.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:17:59.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:17:59.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:17:59.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:00.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:00.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:00.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:00.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:01.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:01.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:01.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:01.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:02.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:02.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:03.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:03.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:03.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:03.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:04.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:04.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:04.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:04.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:04.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:04.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:05.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:05.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:05.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:05.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:06.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:06.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:07.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:07.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:07.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:07.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:08.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:07.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:08.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:08.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:08.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:08.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:09.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:09.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:09.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:09.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:10.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:10.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:10.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:10.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:11.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:11.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:11.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:11.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:12.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:12.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:12.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:12.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:13.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:13.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:13.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:13.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:14.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:14.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:14.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:14.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:15.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:15.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:15.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:15.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:16.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:16.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:16.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:16.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:17.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:17.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:17.946 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:17.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:18.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:18.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:18.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:18.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:19.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:19.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:19.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:19.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:20.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:20.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:20.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:20.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:21.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:21.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:21.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:21.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:22.400 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:22.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:22.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:22.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:23.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:23.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:23.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:23.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:24.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:24.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:24.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:24.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:25.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:25.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:25.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:25.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:26.506 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:26.502+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:26.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:26.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:27.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:27.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:27.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:27.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:28.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:28.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:28.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:28.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:29.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:29.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:29.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:29.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:30.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:30.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:30.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:30.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:31.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:31.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:31.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:31.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:32.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:32.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:32.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:32.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:33.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:33.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:33.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:33.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:34.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:34.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:34.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:34.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:35.711 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:35.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:35.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:35.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:36.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:36.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:36.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:36.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:37.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:37.654+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:37.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:37.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:38.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:38.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:38.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:38.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:39.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:39.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:39.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:39.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:40.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:40.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:40.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:40.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:41.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:41.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:41.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:41.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:42.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:42.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:42.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:42.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:43.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:43.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:43.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:43.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:44.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:44.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:45.029 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:45.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:45.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:45.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:46.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:46.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:46.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:46.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:47.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:47.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:47.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:47.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:48.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:48.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:48.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:48.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:49.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:49.134+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:49.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:49.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:50.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:50.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:50.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:50.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:51.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:51.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:51.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:51.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:52.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:52.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:52.573 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:52.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:53.161 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:53.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:53.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:53.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:54.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:54.154+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:54.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:54.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:55.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:55.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:55.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:55.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:56.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:56.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:56.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:56.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:57.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:57.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:57.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:57.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:58.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:58.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:58.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:58.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:59.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:18:59.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:18:59.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:18:59.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:00.202 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:00.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:00.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:00.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:01.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:01.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:01.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:01.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:02.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:02.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:02.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:02.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:03.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:03.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:03.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:03.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:04.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:04.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:04.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:04.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:05.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:05.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:05.529 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:05.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:06.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:06.213+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:06.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:06.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:07.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:07.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:07.585 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:07.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:08.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:08.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:08.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:08.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:09.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:09.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:09.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:09.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:10.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:10.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:10.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:10.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:11.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:11.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:11.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:11.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:12.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:12.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:12.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:12.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:13.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:13.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:13.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:13.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:14.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:14.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:14.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:14.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:15.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:15.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:15.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:15.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:16.130 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:16.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:16.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:16.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:17.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:17.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:17.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:17.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:18.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:18.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:18.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:18.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:19.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:19.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:19.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:19.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:20.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:20.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:20.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:20.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:21.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:21.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:21.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:21.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:22.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:22.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:22.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:22.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:23.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:23.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:23.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:23.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:24.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:24.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:24.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:24.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:25.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:25.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:25.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:25.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:26.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:26.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:26.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:26.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:27.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:27.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:27.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:27.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:28.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:28.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:28.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:28.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:29.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:29.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:29.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:29.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:30.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:30.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:30.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:30.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:31.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:31.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:31.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:31.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:32.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:32.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:32.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:32.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:33.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:33.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:33.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:33.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:34.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:34.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:34.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:34.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:35.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:35.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:35.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:35.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:36.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:36.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:36.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:36.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:37.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:37.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:37.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:37.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:38.157 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:38.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:38.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:38.388+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:39.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:39.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:39.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:39.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:40.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:40.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:40.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:40.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:41.175 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:41.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:41.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:41.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:42.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:42.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:42.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:42.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:43.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:43.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:43.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:43.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:44.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:44.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:44.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:44.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:45.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:45.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:45.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:45.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:46.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:46.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:46.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:46.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:47.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:47.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:47.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:47.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:48.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:48.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:48.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:48.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:49.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:49.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:49.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:49.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:50.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:50.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:50.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:50.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:51.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:51.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:51.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:51.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:52.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:52.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:52.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:52.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:53.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:53.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:53.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:53.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:54.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:54.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:54.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:54.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:55.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:55.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:55.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:55.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:56.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:56.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:56.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:56.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:57.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:57.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:57.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:57.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:58.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:58.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:58.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:58.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:59.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:19:59.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:19:59.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:19:59.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:00.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:00.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:00.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:00.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:01.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:01.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:01.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:01.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:02.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:02.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:02.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:02.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:03.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:03.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:03.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:03.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:04.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:04.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:04.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:04.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:05.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:05.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:05.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:05.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:06.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:06.340+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:06.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:06.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:07.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:07.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:07.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:07.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:08.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:08.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:08.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:08.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:09.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:09.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:09.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:09.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:10.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:10.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:10.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:10.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:11.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:11.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:11.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:11.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:12.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:12.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:12.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:12.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:13.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:13.356+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:13.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:13.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:14.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:14.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:14.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:14.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:15.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:15.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:15.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:15.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:16.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:16.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:16.515 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:16.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:17.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:17.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:17.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:17.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:18.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:18.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:18.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:18.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:19.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:19.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:19.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:19.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:20.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:20.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:20.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:20.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:21.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:21.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:21.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:21.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:22.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:22.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:22.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:22.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:23.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:23.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:23.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:23.559+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:24.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:24.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:24.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:24.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:25.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:25.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:25.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:25.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:26.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:26.479+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:26.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:26.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:27.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:27.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:27.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:27.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:28.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:28.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:28.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:28.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:29.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:29.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:29.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:29.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:30.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:30.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:30.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:30.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:31.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:31.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:31.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:31.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:32.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:32.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:32.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:32.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:33.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:33.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:33.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:33.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:34.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:34.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:34.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:34.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:35.502 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:35.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:35.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:35.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:36.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:36.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:36.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:36.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:37.531 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:37.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:37.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:37.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:38.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:38.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:38.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:38.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:39.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:39.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:39.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:39.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:40.526 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:40.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:40.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:40.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:41.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:41.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:41.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:41.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:42.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:42.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:42.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:42.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:43.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:43.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:43.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:43.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:44.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:44.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:44.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:44.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:45.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:45.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:45.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:45.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:46.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:46.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:46.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:46.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:47.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:47.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:47.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:47.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:48.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:48.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:48.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:48.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:49.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:49.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:49.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:49.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:50.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:50.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:50.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:50.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:51.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:51.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:51.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:51.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:52.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:52.531+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:52.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:52.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:53.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:53.527+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:53.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:53.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:54.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:54.523+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:54.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:54.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:55.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:55.547+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:55.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:55.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:56.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:56.543+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:56.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:56.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:57.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:57.575+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:57.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:57.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:58.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:58.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:58.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:58.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:59.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:20:59.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:20:59.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:20:59.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:00.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:00.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:00.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:00.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:01.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:01.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:01.821 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:01.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:02.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:02.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:02.820 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:02.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:03.685 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:03.674+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:03.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:03.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:04.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:04.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:04.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:04.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:05.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:05.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:05.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:05.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:06.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:06.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:06.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:06.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:07.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:07.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:07.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:07.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:08.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:08.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:08.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:08.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:09.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:09.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:09.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:09.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:10.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:10.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:10.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:10.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:11.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:11.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:11.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:11.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:12.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:12.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:12.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:12.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:13.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:13.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:13.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:13.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:14.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:14.702+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:14.858 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:14.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:15.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:15.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:15.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:15.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:16.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:16.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:16.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:16.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:17.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:17.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:17.882 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:17.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:18.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:18.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:18.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:18.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:19.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:19.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:19.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:19.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:20.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:20.794+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:20.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:20.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:21.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:21.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:21.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:21.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:22.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:22.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:22.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:22.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:23.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:23.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:23.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:23.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:24.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:24.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:24.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:24.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:25.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:25.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:25.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:25.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:26.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:26.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:26.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:26.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:27.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:27.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:28.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:28.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:28.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:28.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:29.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:28.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:29.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:29.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:30.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:30.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:30.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:30.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:31.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:31.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:31.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:31.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:32.056 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:32.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:32.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:32.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:33.041 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:33.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:33.958 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:33.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:34.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:34.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:34.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:34.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:35.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:35.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:35.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:35.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:36.005 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:35.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:36.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:36.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:37.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:37.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:37.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:37.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:37.986 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:37.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:38.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:38.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:38.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:38.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:39.820 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:39.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:39.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:39.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:40.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:40.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:40.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:40.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:41.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:41.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:42.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:42.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:42.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:42.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:43.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:42.997+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:43.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:43.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:43.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:43.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:44.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:44.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:44.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:44.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:45.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:45.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:45.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:45.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:46.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:46.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:46.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:46.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:47.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:47.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:47.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:47.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:48.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:48.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:49.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:49.005+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:49.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:49.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:50.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:50.049+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:50.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:50.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:51.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:51.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:51.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:51.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:52.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:52.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:52.887 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:52.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:53.133 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:53.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:53.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:53.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:54.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:54.117+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:54.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:54.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:55.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:55.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:55.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:55.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:56.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:56.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:56.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:56.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:57.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:57.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:57.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:57.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:58.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:58.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:58.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:58.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:59.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:21:59.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:21:59.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:21:59.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:00.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:00.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:00.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:00.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:01.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:01.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:01.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:01.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:02.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:02.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:02.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:02.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:03.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:03.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:04.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:03.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:04.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:04.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:05.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:05.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:05.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:05.197+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:06.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:06.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:06.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:06.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:07.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:07.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:07.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:07.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:08.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:08.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:08.230 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:08.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:09.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:09.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:09.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:09.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:10.056 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:10.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:10.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:10.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:11.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:11.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:11.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:11.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:12.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:12.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:12.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:12.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:13.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:12.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:13.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:13.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:14.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:14.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:14.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:14.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:15.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:15.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:15.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:15.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:16.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:16.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:16.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:16.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:17.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:17.065+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:17.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:17.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:18.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:18.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:18.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:18.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:19.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:19.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:19.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:19.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:20.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:20.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:20.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:20.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:21.080 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:21.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:21.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:21.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:22.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:22.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:22.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:22.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:23.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:23.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:23.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:23.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:24.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:24.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:24.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:24.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:25.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:25.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:25.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:25.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:26.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:26.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:26.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:26.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:27.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:27.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:27.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:27.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:28.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:28.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:28.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:28.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:29.119 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:29.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:29.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:29.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:30.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:30.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:30.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:30.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:31.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:31.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:31.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:31.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:32.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:32.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:32.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:32.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:33.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:33.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:33.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:33.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:34.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:34.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:34.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:34.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:35.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:35.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:35.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:35.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:36.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:36.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:36.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:36.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:37.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:37.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:37.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:37.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:38.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:38.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:38.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:38.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:39.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:39.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:39.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:39.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:40.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:40.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:40.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:40.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:41.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:41.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:41.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:41.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:42.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:42.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:42.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:42.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:43.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:43.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:43.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:43.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:44.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:44.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:44.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:44.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:45.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:45.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:45.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:45.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:46.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:46.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:46.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:46.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:47.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:47.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:47.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:47.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:48.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:48.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:48.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:48.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:49.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:49.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:49.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:49.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:50.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:50.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:50.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:50.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:51.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:51.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:51.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:51.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:52.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:52.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:52.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:52.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:53.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:53.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:53.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:53.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:54.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:54.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:54.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:54.320+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:55.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:55.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:55.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:55.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:56.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:56.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:56.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:56.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:57.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:57.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:57.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:57.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:58.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:58.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:58.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:58.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:59.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:22:59.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:22:59.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:22:59.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:00.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:00.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:00.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:00.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:01.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:01.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:01.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:01.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:02.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:02.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:02.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:02.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:03.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:03.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:03.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:03.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:04.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:04.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:04.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:04.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:05.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:05.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:05.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:05.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:06.171 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:06.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:06.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:06.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:07.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:07.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:07.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:07.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:08.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:08.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:08.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:08.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:09.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:09.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:09.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:09.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:10.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:10.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:10.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:10.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:11.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:11.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:11.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:11.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:12.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:12.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:12.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:12.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:13.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:13.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:13.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:13.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:14.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:14.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:14.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:14.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:15.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:15.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:15.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:15.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:16.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:16.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:16.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:16.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:17.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:17.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:17.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:17.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:18.178 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:18.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:18.471 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:18.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:19.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:19.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:19.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:19.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:20.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:20.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:20.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:20.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:21.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:21.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:21.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:21.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:22.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:22.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:22.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:22.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:23.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:23.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:23.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:23.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:24.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:24.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:24.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:24.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:25.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:25.107+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:25.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:25.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:26.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:26.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:26.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:26.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:27.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:27.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:27.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:27.291+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:28.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:28.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:28.334 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:28.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:29.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:29.087+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:29.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:29.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:30.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:30.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:30.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:30.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:31.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:31.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:31.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:31.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:32.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:32.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:32.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:32.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:33.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:33.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:33.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:33.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:33.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:33.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:34.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:34.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:34.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:34.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:35.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:35.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:35.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:35.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:36.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:36.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:36.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:36.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:37.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:37.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:37.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:37.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:38.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:38.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:39.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:38.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:39.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:39.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:39.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:39.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:40.194 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:40.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:40.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:40.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:41.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:41.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:42.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:42.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:42.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:42.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:42.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:42.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:43.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:43.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:44.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:43.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:44.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:44.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:45.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:45.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:45.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:45.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:46.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:46.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:46.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:46.086+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:46.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:46.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:47.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:47.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:47.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:47.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:48.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:48.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:48.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:48.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:49.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:49.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:49.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:49.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:50.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:50.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:50.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:50.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:51.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:51.026+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:52.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:52.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:52.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:52.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:53.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:53.030+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:53.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:53.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:54.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:54.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:54.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:54.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:55.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:54.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:55.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:55.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:56.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:55.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:56.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:56.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:56.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:56.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:57.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:57.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:57.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:57.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:58.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:58.062+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:58.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:58.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:59.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:23:59.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:23:59.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:23:59.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:00.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:00.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:00.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:00.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:01.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:01.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:01.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:01.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:02.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:02.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:02.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:02.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:03.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:03.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:03.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:03.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:04.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:04.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:04.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:04.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:05.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:05.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:05.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:05.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:06.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:06.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:06.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:06.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:07.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:07.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:07.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:07.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:08.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:08.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:08.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:08.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:09.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:09.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:09.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:09.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:10.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:10.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:10.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:10.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:11.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:11.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:11.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:11.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:12.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:12.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:12.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:12.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:13.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:13.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:13.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:13.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:14.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:14.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:14.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:14.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:15.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:15.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:15.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:15.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:16.126 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:16.122+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:16.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:16.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:17.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:17.074+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:17.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:17.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:18.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:18.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:18.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:18.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:19.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:19.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:19.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:19.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:20.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:20.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:20.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:20.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:21.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:21.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:21.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:21.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:22.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:22.166+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:22.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:22.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:23.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:23.126+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:23.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:23.874+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:24.091 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:24.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:24.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:24.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:25.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:25.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:25.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:25.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:26.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:26.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:26.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:26.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:27.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:27.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:27.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:27.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:28.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:28.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:28.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:28.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:29.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:29.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:29.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:29.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:30.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:30.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:30.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:30.917+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:31.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:31.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:31.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:31.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:32.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:32.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:32.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:32.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:33.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:33.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:33.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:33.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:34.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:34.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:34.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:34.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:35.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:35.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:35.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:35.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:36.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:36.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:36.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:36.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:37.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:37.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:37.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:37.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:38.190 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:38.185+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:38.953 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:38.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:39.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:39.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:39.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:39.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:40.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:40.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:40.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:40.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:41.188 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:41.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:41.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:41.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:42.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:42.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:42.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:42.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:43.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:43.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:43.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:43.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:44.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:44.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:44.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:44.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:45.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:45.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:45.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:45.813+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:46.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:46.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:46.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:46.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:47.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:47.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:47.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:47.829+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:48.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:48.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:48.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:48.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:49.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:49.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:49.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:49.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:50.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:50.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:50.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:50.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:51.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:51.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:51.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:51.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:52.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:52.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:52.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:52.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:53.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:53.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:53.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:53.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:54.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:54.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:54.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:54.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:55.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:55.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:55.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:55.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:56.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:56.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:56.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:56.861+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:56.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:56.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:57.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:57.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:57.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:57.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:58.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:58.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:58.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:58.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:59.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:24:59.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:24:59.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:24:59.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:00.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:00.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:00.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:00.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:01.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:01.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:01.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:01.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:02.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:02.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:02.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:02.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:03.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:03.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:03.942 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:03.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:04.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:04.869+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:04.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:04.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:05.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:05.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:05.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:05.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:06.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:06.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:06.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:06.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:07.859 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:07.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:07.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:07.873+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:08.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:08.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:08.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:08.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:09.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:09.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:09.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:09.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:10.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:10.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:10.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:10.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:11.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:11.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:11.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:11.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:12.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:12.864+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:12.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:12.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:13.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:13.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:13.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:13.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:14.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:14.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:14.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:14.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:15.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:15.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:15.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:15.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:16.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:16.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:16.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:16.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:17.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:17.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:17.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:17.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:18.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:18.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:18.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:18.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:19.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:19.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:19.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:19.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:20.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:20.808+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:20.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:20.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:21.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:21.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:21.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:21.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:22.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:22.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:22.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:22.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:23.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:23.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:23.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:23.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:24.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:24.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:25.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:25.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:25.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:25.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:26.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:26.056+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:26.835 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:26.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:27.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:27.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:27.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:27.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:28.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:28.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:28.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:28.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:28.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:28.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:29.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:29.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:30.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:30.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:30.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:30.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:31.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:31.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:31.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:31.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:32.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:32.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:32.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:32.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:33.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:33.084+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:33.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:33.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:34.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:34.104+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:34.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:34.972+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:35.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:35.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:35.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:35.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:36.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:36.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:36.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:36.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:37.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:37.176+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:37.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:37.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:38.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:38.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:38.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:38.888+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:39.236 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:39.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:39.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:39.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:40.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:40.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:40.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:40.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:41.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:41.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:41.922 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:41.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:42.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:42.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:42.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:42.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:43.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:43.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:43.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:43.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:44.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:44.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:44.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:44.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:45.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:45.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:45.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:45.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:46.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:46.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:46.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:46.976+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:47.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:47.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:47.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:47.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:48.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:48.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:48.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:48.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:49.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:49.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:49.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:49.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:50.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:50.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:50.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:50.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:51.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:51.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:51.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:51.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:52.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:52.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:52.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:52.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:53.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:53.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:53.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:53.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:54.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:54.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:54.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:54.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:55.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:55.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:55.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:55.911+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:56.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:56.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:56.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:56.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:57.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:57.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:57.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:57.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:58.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:58.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:58.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:58.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:59.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:25:59.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:25:59.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:25:59.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:00.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:00.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:00.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:00.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:01.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:01.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:01.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:01.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:02.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:02.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:02.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:02.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:03.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:03.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:03.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:03.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:04.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:04.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:04.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:04.931+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:05.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:05.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:05.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:05.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:06.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:06.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:06.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:06.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:07.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:07.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:08.017 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:08.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:08.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:08.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:09.006 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:08.995+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:09.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:09.299+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:10.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:10.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:10.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:10.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:11.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:11.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:11.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:11.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:11.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:11.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:12.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:12.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:13.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:13.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:13.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:13.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:14.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:14.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:14.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:14.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:15.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:15.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:15.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:15.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:16.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:16.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:16.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:16.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:17.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:17.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:17.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:17.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:18.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:18.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:18.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:18.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:19.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:19.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:19.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:19.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:20.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:20.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:20.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:20.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:21.082 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:21.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:21.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:21.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:22.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:22.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:22.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:22.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:23.090 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:23.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:23.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:23.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:24.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:24.067+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:24.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:24.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:25.114 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:25.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:25.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:25.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:26.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:26.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:26.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:26.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:27.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:27.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:27.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:27.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:28.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:28.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:28.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:28.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:29.148 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:29.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:29.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:29.395+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:30.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:30.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:30.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:30.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:31.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:31.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:31.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:31.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:32.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:32.106+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:32.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:32.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:33.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:33.146+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:33.349 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:33.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:34.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:34.190+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:34.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:34.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:35.170 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:35.162+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:35.292 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:35.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:36.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:36.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:36.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:36.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:37.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:37.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:37.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:37.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:38.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:38.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:38.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:38.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:39.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:39.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:39.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:39.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:40.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:40.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:40.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:40.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:41.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:41.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:41.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:41.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:42.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:42.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:42.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:42.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:43.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:43.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:43.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:43.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:44.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:44.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:44.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:44.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:45.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:45.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:45.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:45.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:46.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:46.098+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:46.220 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:46.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:47.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:47.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:47.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:47.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:48.070 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:48.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:48.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:48.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:49.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:49.082+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:49.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:49.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:50.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:50.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:50.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:50.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:51.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:51.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:51.283 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:51.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:52.092 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:52.086+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:52.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:52.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:53.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:53.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:53.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:53.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:54.117 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:54.110+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:54.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:54.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:55.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:55.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:55.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:55.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:56.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:56.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:56.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:56.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:57.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:57.170+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:57.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:57.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:58.135 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:58.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:58.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:58.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:59.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:26:59.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:26:59.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:26:59.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:00.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:00.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:00.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:00.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:01.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:01.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:01.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:01.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:02.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:02.118+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:02.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:02.458+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:03.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:03.114+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:03.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:03.510+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:04.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:04.106+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:04.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:04.522+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:05.100 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:05.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:05.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:05.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:06.151 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:06.146+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:06.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:06.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:07.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:07.138+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:07.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:07.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:08.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:08.094+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:08.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:08.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:09.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:09.130+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:09.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:09.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:10.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:10.150+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:10.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:10.554+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:11.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:11.182+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:11.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:11.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:12.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:12.186+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:12.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:12.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:13.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:13.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:13.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:13.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:14.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:14.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:14.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:14.621+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:15.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:15.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:15.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:15.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:16.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:16.193+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:16.689 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:16.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:17.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:17.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:17.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:17.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:18.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:18.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:18.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:18.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:19.103 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:19.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:19.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:19.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:20.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:20.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:20.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:20.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:21.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:21.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:21.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:21.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:22.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:22.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:22.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:22.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:23.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:23.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:23.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:23.693+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:24.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:24.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:24.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:24.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:25.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:25.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:25.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:25.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:26.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:26.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:26.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:26.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:27.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:27.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:27.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:27.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:28.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:28.061+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:28.782 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:28.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:29.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:29.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:29.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:29.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:30.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:30.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:30.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:30.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:31.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:31.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:31.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:31.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:32.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:32.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:32.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:32.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:33.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:33.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:33.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:33.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:34.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:34.081+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:34.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:34.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:35.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:35.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:35.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:35.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:36.079 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:36.073+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:36.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:36.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:37.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:37.109+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:37.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:37.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:38.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:38.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:38.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:39.140 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:39.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:39.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:39.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:40.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:40.113+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:40.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:40.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:41.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:41.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:41.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:41.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:42.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:42.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:42.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:42.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:43.053 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:43.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:43.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:43.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:44.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:44.053+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:44.896 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:44.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:45.063 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:45.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:45.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:45.897+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:46.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:46.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:46.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:46.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:46.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:46.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:47.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:47.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:47.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:47.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:48.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:48.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:48.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:48.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:49.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:49.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:49.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:49.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:50.778 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:50.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:50.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:50.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:51.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:51.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:51.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:51.821+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:52.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:52.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:52.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:52.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:53.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:53.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:53.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:53.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:54.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:54.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:54.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:54.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:55.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:55.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:55.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:55.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:56.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:56.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:56.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:56.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:57.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:57.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:57.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:57.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:58.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:58.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:58.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:58.792+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:59.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:27:59.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:27:59.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:27:59.804+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:00.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:00.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:00.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:00.768+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:01.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:01.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:01.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:01.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:02.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:02.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:02.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:02.812+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:03.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:03.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:03.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:03.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:04.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:04.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:04.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:04.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:05.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:05.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:05.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:05.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:06.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:06.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:06.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:06.832+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:07.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:07.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:07.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:07.796+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:08.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:08.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:08.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:08.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:09.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:09.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:09.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:09.820+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:10.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:10.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:10.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:10.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:11.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:11.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:11.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:11.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:12.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:12.652+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:12.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:12.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:13.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:13.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:13.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:13.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:14.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:14.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:14.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:14.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:15.644 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:15.636+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:15.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:15.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:16.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:16.676+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:16.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:16.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:17.651 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:17.644+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:17.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:17.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:18.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:18.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:18.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:18.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:19.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:19.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:19.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:19.736+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:20.657 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:20.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:20.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:20.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:21.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:21.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:21.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:21.724+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:22.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:22.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:22.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:22.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:23.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:23.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:23.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:23.744+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:24.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:24.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:24.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:24.780+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:25.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:25.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:25.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:25.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:26.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:26.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:26.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:26.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:27.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:27.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:27.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:27.760+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:28.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:28.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:28.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:28.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:29.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:29.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:29.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:29.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:30.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:30.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:30.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:30.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:31.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:31.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:31.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:31.732+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:32.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:32.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:32.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:32.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:33.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:33.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:33.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:33.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:34.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:34.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:34.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:34.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:35.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:35.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:35.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:35.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:36.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:36.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:36.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:36.735+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:37.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:37.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:37.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:37.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:38.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:38.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:38.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:38.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:39.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:39.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:39.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:39.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:40.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:40.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:40.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:40.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:41.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:41.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:41.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:41.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:42.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:42.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:42.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:42.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:43.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:43.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:43.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:43.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:44.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:44.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:44.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:44.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:45.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:45.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:45.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:45.655+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:46.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:46.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:46.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:46.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:47.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:47.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:47.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:47.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:48.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:48.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:48.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:48.695+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:49.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:49.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:49.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:49.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:50.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:50.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:50.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:50.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:51.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:51.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:51.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:51.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:52.599 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:52.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:52.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:52.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:53.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:53.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:53.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:53.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:54.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:54.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:54.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:54.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:55.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:55.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:55.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:55.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:56.642 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:56.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:56.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:56.659+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:57.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:57.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:57.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:57.679+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:58.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:58.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:58.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:58.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:59.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:28:59.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:28:59.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:28:59.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:00.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:00.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:00.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:00.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:01.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:01.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:01.684 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:01.675+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:02.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:02.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:02.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:02.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:03.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:03.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:03.652 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:03.639+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:04.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:04.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:04.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:04.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:05.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:05.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:05.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:05.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:06.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:06.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:06.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:06.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:07.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:07.567+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:07.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:07.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:08.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:08.583+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:08.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:08.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:09.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:09.575+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:09.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:09.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:10.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:10.551+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:10.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:10.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:11.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:11.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:11.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:11.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:12.617 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:12.607+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:12.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:12.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:13.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:13.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:13.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:13.683+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:14.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:14.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:14.724 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:14.715+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:15.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:15.571+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:15.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:15.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:16.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:16.595+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:16.702 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:16.691+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:17.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:17.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:17.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:17.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:18.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:18.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:18.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:18.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:19.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:19.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:19.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:19.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:20.638 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:20.630+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:20.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:20.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:21.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:21.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:21.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:21.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:22.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:22.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:22.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:22.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:23.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:23.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:23.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:23.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:24.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:24.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:24.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:24.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:25.598 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:25.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:25.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:25.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:26.553 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:26.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:26.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:26.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:27.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:27.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:27.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:27.730+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:28.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:28.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:28.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:28.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:29.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:29.542+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:29.772 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:29.766+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:30.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:30.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:30.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:30.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:31.513 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:31.506+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:31.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:31.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:32.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:32.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:32.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:32.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:33.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:33.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:33.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:33.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:34.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:34.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:34.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:34.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:35.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:35.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:35.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:35.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:36.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:36.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:36.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:36.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:37.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:37.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:37.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:37.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:38.546 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:38.538+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:38.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:38.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:39.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:39.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:39.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:39.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:40.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:40.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:40.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:40.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:41.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:41.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:41.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:41.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:42.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:42.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:42.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:42.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:43.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:43.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:43.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:43.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:44.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:44.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:45.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:45.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:45.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:45.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:45.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:45.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:46.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:46.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:47.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:47.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:47.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:47.494+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:47.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:47.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:48.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:48.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:48.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:48.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:49.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:49.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:49.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:49.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:50.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:50.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:50.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:50.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:51.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:51.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:51.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:51.966+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:52.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:52.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:53.012 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:53.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:53.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:53.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:54.004 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:53.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:54.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:54.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:54.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:54.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:55.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:55.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:55.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:55.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:56.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:56.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:56.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:56.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:57.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:57.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:57.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:57.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:58.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:58.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:59.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:29:59.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:29:59.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:29:59.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:00.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:00.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:00.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:00.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:01.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:01.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:01.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:01.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:02.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:02.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:02.315 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:02.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:03.073 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:03.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:03.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:03.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:04.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:04.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:04.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:04.217+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:05.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:05.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:05.185 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:05.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:06.100 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:06.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:06.183 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:06.177+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:07.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:07.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:07.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:07.209+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:08.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:08.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:08.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:08.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:09.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:09.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:09.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:09.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:10.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:10.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:10.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:10.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:11.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:11.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:11.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:11.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:12.090 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:12.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:12.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:12.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:13.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:13.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:13.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:13.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:14.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:14.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:14.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:14.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:15.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:15.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:15.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:15.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:16.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:16.033+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:16.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:16.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:17.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:17.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:17.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:17.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:18.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:18.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:18.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:18.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:19.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:19.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:19.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:19.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:20.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:20.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:20.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:20.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:21.051 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:21.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:21.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:21.089+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:22.060 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:22.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:22.074 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:22.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:23.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:23.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:23.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:23.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:24.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:24.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:24.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:24.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:25.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:25.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:25.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:25.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:26.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:26.053+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:26.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:26.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:27.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:27.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:27.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:27.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:28.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:28.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:28.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:28.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:29.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:29.093+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:29.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:29.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:30.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:30.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:30.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:30.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:31.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:31.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:31.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:31.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:32.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:32.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:32.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:32.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:33.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:33.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:33.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:33.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:34.108 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:34.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:34.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:34.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:35.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:35.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:35.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:35.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:36.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:36.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:36.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:36.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:37.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:37.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:37.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:37.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:38.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:38.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:38.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:38.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:39.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:39.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:39.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:39.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:40.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:40.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:40.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:40.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:41.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:41.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:41.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:41.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:42.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:42.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:42.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:42.312+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:43.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:43.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:43.325 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:43.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:44.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:44.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:44.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:44.348+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:45.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:45.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:45.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:45.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:46.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:46.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:46.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:46.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:47.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:47.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:47.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:47.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:48.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:48.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:48.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:48.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:49.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:49.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:49.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:49.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:50.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:50.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:50.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:50.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:51.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:51.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:51.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:51.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:52.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:52.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:52.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:52.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:53.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:53.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:53.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:53.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:54.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:54.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:54.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:54.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:55.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:55.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:55.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:55.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:56.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:56.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:56.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:56.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:57.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:57.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:57.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:57.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:58.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:58.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:58.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:58.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:59.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:30:59.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:30:59.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:30:59.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:00.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:00.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:00.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:00.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:01.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:01.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:01.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:01.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:02.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:02.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:02.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:02.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:03.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:03.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:03.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:03.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:04.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:04.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:04.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:04.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:05.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:05.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:05.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:05.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:06.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:06.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:06.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:06.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:07.141 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:07.132+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:07.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:07.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:08.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:08.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:08.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:08.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:09.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:09.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:09.391 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:09.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:10.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:10.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:10.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:10.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:11.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:11.020+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:11.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:11.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:12.048 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:12.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:12.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:12.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:13.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:12.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:13.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:13.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:14.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:14.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:14.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:14.380+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:15.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:15.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:15.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:15.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:15.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:15.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:16.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:16.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:16.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:16.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:17.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:17.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:17.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:17.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:18.382 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:18.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:18.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:18.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:19.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:19.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:19.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:19.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:20.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:20.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:21.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:21.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:21.367 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:21.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:22.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:22.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:22.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:22.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:23.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:23.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:23.404 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:23.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:24.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:24.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:24.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:24.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:25.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:25.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:25.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:25.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:26.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:26.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:26.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:26.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:27.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:26.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:27.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:27.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:28.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:28.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:28.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:28.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:29.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:29.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:29.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:29.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:29.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:29.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:30.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:30.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:30.987 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:30.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:31.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:31.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:32.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:32.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:32.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:32.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:33.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:32.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:33.448 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:33.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:34.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:34.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:34.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:34.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:35.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:34.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:35.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:35.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:35.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:35.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:36.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:36.359+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:36.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:36.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:37.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:37.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:37.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:37.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:38.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:38.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:38.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:38.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:39.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:39.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:39.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:39.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:40.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:40.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:40.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:40.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:41.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:41.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:41.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:41.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:42.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:42.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:42.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:42.759+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:43.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:43.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:43.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:43.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:44.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:44.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:44.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:44.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:45.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:45.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:45.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:45.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:46.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:46.315+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:46.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:46.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:47.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:47.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:47.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:47.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:48.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:48.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:48.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:48.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:49.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:49.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:49.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:49.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:50.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:50.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:50.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:50.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:51.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:51.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:52.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:51.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:52.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:52.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:52.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:52.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:53.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:53.339+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:53.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:53.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:54.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:54.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:54.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:54.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:55.388 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:55.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:55.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:55.887+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:56.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:56.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:56.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:56.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:57.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:57.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:57.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:57.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:58.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:58.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:58.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:58.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:59.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:31:59.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:31:59.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:31:59.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:00.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:00.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:00.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:00.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:01.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:01.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:02.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:01.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:02.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:02.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:03.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:03.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:03.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:03.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:04.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:04.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:04.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:04.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:05.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:05.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:05.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:05.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:05.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:05.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:06.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:06.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:07.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:07.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:07.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:07.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:08.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:08.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:08.343 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:08.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:09.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:09.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:09.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:09.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:10.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:10.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:10.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:10.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:10.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:10.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:11.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:11.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:11.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:11.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:12.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:12.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:12.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:12.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:13.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:13.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:13.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:13.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:14.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:14.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:14.918 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:14.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:15.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:15.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:15.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:15.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:16.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:16.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:16.915 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:16.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:17.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:17.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:17.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:17.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:18.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:18.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:18.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:18.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:19.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:19.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:19.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:19.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:20.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:20.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:20.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:20.906+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:21.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:21.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:21.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:21.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:22.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:22.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:22.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:22.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:23.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:23.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:23.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:23.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:24.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:24.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:24.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:24.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:25.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:25.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:25.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:25.834+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:26.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:26.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:26.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:26.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:27.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:27.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:27.875 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:27.870+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:28.355 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:28.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:28.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:28.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:29.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:29.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:29.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:29.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:30.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:30.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:30.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:30.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:31.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:31.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:31.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:31.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:32.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:32.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:32.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:32.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:33.356 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:33.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:33.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:33.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:34.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:34.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:34.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:34.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:35.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:35.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:35.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:35.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:36.376 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:36.370+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:36.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:36.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:37.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:37.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:37.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:37.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:38.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:38.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:38.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:38.826+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:39.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:39.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:39.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:39.850+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:40.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:40.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:40.865 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:40.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:41.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:41.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:41.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:41.854+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:42.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:42.470+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:42.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:42.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:43.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:43.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:43.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:43.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:44.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:44.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:44.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:44.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:45.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:45.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:45.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:45.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:46.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:46.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:46.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:46.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:47.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:47.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:47.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:47.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:48.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:48.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:48.818 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:48.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:49.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:49.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:49.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:49.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:50.428 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:50.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:50.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:50.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:51.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:51.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:51.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:51.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:52.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:52.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:52.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:52.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:53.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:53.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:53.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:53.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:54.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:54.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:54.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:54.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:55.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:55.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:55.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:55.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:56.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:56.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:56.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:56.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:57.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:57.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:57.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:57.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:58.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:58.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:58.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:58.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:59.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:32:59.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:32:59.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:32:59.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:00.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:00.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:00.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:00.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:01.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:01.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:01.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:01.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:02.369 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:02.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:02.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:02.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:03.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:03.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:03.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:03.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:04.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:04.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:04.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:04.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:05.327 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:05.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:05.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:05.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:06.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:06.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:06.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:06.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:07.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:07.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:07.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:07.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:08.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:08.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:08.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:08.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:09.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:09.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:09.694 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:09.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:10.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:10.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:10.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:10.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:11.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:11.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:11.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:11.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:12.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:12.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:12.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:12.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:13.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:13.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:13.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:13.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:14.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:14.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:14.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:14.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:15.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:15.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:15.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:15.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:16.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:16.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:16.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:16.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:17.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:17.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:17.832 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:17.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:18.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:18.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:18.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:18.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:19.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:19.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:19.794 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:19.789+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:20.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:20.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:20.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:20.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:21.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:21.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:21.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:21.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:22.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:22.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:22.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:22.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:23.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:23.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:23.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:23.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:24.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:24.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:24.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:24.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:25.303 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:25.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:25.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:25.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:26.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:26.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:26.718 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:26.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:27.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:27.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:27.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:27.692+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:28.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:28.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:28.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:28.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:29.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:29.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:29.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:29.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:30.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:30.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:30.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:30.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:31.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:31.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:31.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:31.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:32.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:32.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:32.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:32.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:33.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:33.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:33.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:33.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:34.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:34.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:34.663 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:34.656+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:35.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:35.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:35.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:35.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:36.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:36.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:36.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:36.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:37.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:37.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:37.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:37.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:38.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:38.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:38.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:38.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:39.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:39.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:39.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:39.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:40.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:40.484+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:40.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:40.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:41.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:41.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:41.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:41.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:42.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:42.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:42.606 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:42.600+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:43.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:43.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:43.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:43.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:44.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:44.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:44.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:44.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:45.338 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:45.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:45.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:45.624+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:46.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:46.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:46.666 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:46.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:47.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:47.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:47.680 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:47.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:48.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:48.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:48.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:48.664+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:49.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:49.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:49.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:49.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:50.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:50.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:50.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:50.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:51.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:51.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:51.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:51.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:52.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:52.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:52.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:52.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:53.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:53.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:53.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:53.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:54.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:54.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:54.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:54.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:55.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:55.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:55.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:55.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:56.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:56.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:56.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:56.592+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:57.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:57.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:57.558 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:57.548+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:58.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:58.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:58.597 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:58.588+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:59.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:33:59.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:33:59.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:33:59.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:00.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:00.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:00.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:00.568+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:01.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:01.528+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:01.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:01.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:02.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:02.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:02.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:02.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:03.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:03.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:03.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:03.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:04.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:04.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:04.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:04.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:05.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:05.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:05.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:05.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:06.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:06.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:06.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:06.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:07.582 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:07.572+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:07.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:07.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:08.603 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:08.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:08.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:08.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:09.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:09.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:09.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:09.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:10.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:10.591+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:10.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:10.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:11.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:11.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:11.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:11.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:12.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:12.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:12.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:12.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:13.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:13.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:13.724 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:13.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:14.569 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:14.559+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:14.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:14.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:15.586 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:15.579+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:15.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:15.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:16.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:16.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:16.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:16.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:17.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:17.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:17.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:17.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:18.616 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:18.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:18.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:18.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:19.628 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:19.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:19.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:19.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:20.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:20.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:20.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:20.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:21.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:21.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:21.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:21.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:22.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:22.659+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:22.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:22.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:23.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:23.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:23.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:23.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:24.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:24.671+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:24.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:24.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:25.676 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:25.667+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:25.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:25.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:26.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:26.619+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:26.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:26.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:27.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:27.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:27.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:27.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:28.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:28.651+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:28.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:28.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:29.632 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:29.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:29.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:29.791+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:30.594 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:30.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:30.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:30.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:31.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:31.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:31.769 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:31.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:32.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:32.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:32.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:32.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:33.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:33.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:33.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:33.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:34.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:34.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:34.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:34.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:35.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:35.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:35.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:35.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:36.562 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:36.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:36.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:36.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:37.560 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:37.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:37.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:37.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:38.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:38.587+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:38.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:38.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:39.592 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:39.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:39.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:39.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:40.565 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:40.555+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:40.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:40.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:41.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:41.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:41.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:41.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:42.617 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:42.607+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:42.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:42.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:43.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:43.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:43.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:43.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:44.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:44.571+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:44.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:44.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:45.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:45.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:45.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:45.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:46.602 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:46.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:46.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:46.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:47.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:47.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:47.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:47.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:48.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:48.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:48.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:48.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:49.613 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:49.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:49.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:49.662+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:50.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:50.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:50.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:50.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:51.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:51.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:51.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:51.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:52.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:52.586+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:52.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:52.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:53.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:53.614+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:53.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:53.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:54.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:54.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:54.682 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:54.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:55.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:55.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:55.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:55.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:56.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:56.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:56.681 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:56.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:57.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:57.634+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:57.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:57.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:58.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:58.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:58.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:58.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:59.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:34:59.590+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:34:59.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:34:59.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:00.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:00.610+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:00.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:00.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:01.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:01.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:01.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:01.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:02.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:02.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:02.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:02.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:03.654 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:03.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:03.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:03.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:04.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:04.646+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:04.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:04.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:05.608 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:05.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:05.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:05.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:06.625 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:06.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:06.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:06.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:07.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:07.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:07.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:07.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:08.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:08.650+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:08.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:08.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:09.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:09.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:09.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:09.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:10.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:10.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:10.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:10.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:11.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:11.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:11.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:11.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:12.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:12.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:12.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:12.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:13.731 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:13.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:13.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:13.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:14.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:14.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:14.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:14.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:15.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:15.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:15.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:15.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:16.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:16.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:16.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:16.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:17.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:17.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:17.964 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:17.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:18.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:18.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:18.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:18.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:19.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:19.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:20.021 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:20.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:20.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:20.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:21.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:21.054+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:21.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:21.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:22.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:22.098+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:22.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:22.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:23.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:23.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:23.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:23.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:24.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:24.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:24.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:24.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:25.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:25.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:25.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:25.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:26.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:26.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:26.777 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:26.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:27.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:27.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:27.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:27.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:28.025 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:28.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:28.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:28.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:29.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:29.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:29.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:29.710+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:30.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:30.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:30.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:30.758+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:31.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:31.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:31.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:31.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:32.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:32.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:32.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:32.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:33.093 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:33.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:33.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:33.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:34.051 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:34.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:34.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:34.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:35.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:35.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:35.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:35.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:36.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:36.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:36.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:36.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:37.077 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:37.069+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:37.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:37.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:38.044 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:38.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:38.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:38.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:39.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:39.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:39.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:39.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:40.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:40.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:40.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:40.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:41.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:41.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:41.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:41.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:42.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:42.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:42.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:42.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:43.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:43.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:43.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:43.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:44.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:44.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:44.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:44.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:45.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:45.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:45.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:45.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:46.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:46.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:46.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:46.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:47.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:47.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:47.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:47.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:48.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:48.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:48.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:48.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:49.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:49.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:49.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:49.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:50.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:50.293+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:50.851 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:50.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:51.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:51.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:51.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:51.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:52.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:52.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:52.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:52.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:53.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:53.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:53.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:53.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:54.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:54.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:54.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:54.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:55.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:55.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:55.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:55.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:56.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:56.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:56.805 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:56.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:57.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:57.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:57.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:57.777+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:58.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:58.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:58.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:58.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:59.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:35:59.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:35:59.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:35:59.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:00.416 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:00.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:00.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:00.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:01.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:01.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:01.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:01.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:02.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:02.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:02.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:02.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:03.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:03.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:03.758 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:03.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:04.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:04.497+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:04.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:04.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:05.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:05.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:05.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:05.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:06.491 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:06.485+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:06.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:06.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:07.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:07.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:07.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:07.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:08.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:08.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:08.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:08.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:09.543 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:09.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:09.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:09.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:10.547 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:10.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:10.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:10.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:11.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:11.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:11.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:11.741+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:12.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:12.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:12.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:12.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:13.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:13.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:13.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:13.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:14.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:14.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:14.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:14.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:15.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:15.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:15.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:15.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:16.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:16.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:16.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:16.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:17.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:17.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:17.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:17.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:18.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:18.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:18.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:18.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:19.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:19.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:19.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:19.684+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:20.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:20.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:20.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:20.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:21.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:21.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:21.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:21.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:22.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:22.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:22.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:22.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:23.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:23.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:23.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:23.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:24.623 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:24.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:24.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:24.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:25.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:25.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:25.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:25.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:26.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:26.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:26.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:26.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:27.669 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:27.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:27.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:27.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:28.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:28.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:28.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:28.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:29.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:29.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:29.703 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:29.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:30.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:30.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:30.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:30.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:31.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:31.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:31.709 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:31.700+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:32.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:32.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:32.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:32.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:33.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:33.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:33.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:33.712+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:34.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:34.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:34.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:34.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:35.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:35.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:35.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:35.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:36.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:36.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:36.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:36.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:37.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:37.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:37.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:37.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:38.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:38.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:38.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:38.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:39.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:39.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:39.730 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:39.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:40.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:40.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:40.728 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:40.720+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:41.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:41.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:41.689 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:41.680+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:42.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:42.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:42.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:42.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:43.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:43.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:43.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:43.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:44.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:44.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:44.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:44.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:45.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:45.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:45.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:45.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:46.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:46.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:46.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:46.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:47.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:47.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:47.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:47.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:48.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:48.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:48.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:48.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:49.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:49.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:49.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:49.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:50.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:50.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:50.738 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:50.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:51.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:51.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:51.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:51.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:52.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:52.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:52.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:52.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:53.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:53.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:53.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:53.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:54.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:54.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:54.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:54.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:55.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:55.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:55.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:55.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:56.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:56.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:56.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:56.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:57.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:57.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:57.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:57.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:58.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:58.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:58.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:58.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:59.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:36:59.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:36:59.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:36:59.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:00.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:00.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:00.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:00.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:01.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:01.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:01.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:01.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:02.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:02.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:02.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:02.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:03.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:03.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:03.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:03.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:04.678 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:04.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:04.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:04.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:05.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:05.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:05.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:05.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:06.700 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:06.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:06.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:06.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:07.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:07.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:07.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:07.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:08.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:08.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:08.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:08.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:09.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:09.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:09.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:09.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:10.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:10.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:10.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:10.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:11.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:11.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:11.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:11.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:12.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:12.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:12.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:12.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:13.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:13.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:13.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:13.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:14.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:14.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:14.899 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:14.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:15.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:15.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:15.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:15.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:16.771 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:16.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:16.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:16.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:17.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:17.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:17.785 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:17.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:18.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:18.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:18.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:18.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:19.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:19.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:19.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:19.779+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:20.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:20.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:20.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:20.751+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:21.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:21.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:21.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:21.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:22.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:22.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:22.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:22.783+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:23.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:23.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:23.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:23.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:24.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:24.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:24.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:24.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:25.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:25.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:25.819 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:25.811+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:26.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:26.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:26.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:26.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:27.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:27.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:27.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:27.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:28.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:28.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:28.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:28.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:29.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:29.671+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:29.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:29.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:30.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:30.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:30.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:30.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:31.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:31.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:31.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:31.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:32.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:32.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:32.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:32.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:33.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:33.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:33.856 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:33.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:34.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:34.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:34.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:34.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:35.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:35.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:35.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:35.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:36.710 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:36.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:36.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:36.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:37.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:37.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:37.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:37.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:38.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:38.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:38.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:38.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:39.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:39.646+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:39.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:39.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:40.634 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:40.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:40.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:40.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:41.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:41.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:41.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:41.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:42.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:42.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:42.943 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:42.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:43.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:43.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:43.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:43.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:44.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:44.538+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:44.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:44.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:45.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:45.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:45.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:45.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:46.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:46.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:46.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:46.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:47.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:47.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:47.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:47.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:48.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:48.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:49.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:48.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:49.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:49.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:50.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:50.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:50.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:50.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:50.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:50.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:51.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:51.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:52.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:52.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:52.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:52.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:53.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:53.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:53.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:53.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:53.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:53.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:54.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:54.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:54.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:54.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:55.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:55.430+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:55.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:55.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:56.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:56.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:57.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:57.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:57.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:57.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:58.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:58.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:58.402 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:58.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:59.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:37:59.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:37:59.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:37:59.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:00.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:00.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:00.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:00.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:00.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:00.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:01.414 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:01.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:01.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:01.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:02.374 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:02.366+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:02.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:02.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:03.419 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:03.414+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:03.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:03.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:04.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:04.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:04.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:04.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:05.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:05.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:05.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:05.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:06.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:06.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:06.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:06.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:07.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:07.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:08.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:08.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:08.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:08.498+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:09.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:09.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:09.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:09.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:10.083 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:10.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:10.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:10.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:11.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:11.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:11.459 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:11.454+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:12.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:12.038+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:12.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:12.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:13.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:13.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:13.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:13.482+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:14.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:14.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:14.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:14.450+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:15.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:15.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:15.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:15.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:16.095 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:16.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:16.395 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:16.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:17.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:17.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:17.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:17.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:18.112 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:18.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:18.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:18.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:19.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:19.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:19.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:19.393+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:20.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:20.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:20.445 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:20.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:21.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:21.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:21.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:21.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:22.156 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:22.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:22.443 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:22.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:23.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:23.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:23.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:23.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:24.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:24.085+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:24.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:24.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:25.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:25.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:25.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:25.397+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:26.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:26.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:26.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:26.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:27.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:27.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:27.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:27.405+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:27.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:27.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:28.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:28.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:28.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:28.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:29.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:29.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:30.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:30.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:30.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:30.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:30.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:30.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:31.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:31.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:31.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:31.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:32.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:32.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:32.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:32.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:33.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:33.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:34.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:34.017+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:34.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:34.445+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:35.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:34.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:35.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:35.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:35.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:35.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:36.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:36.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:36.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:36.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:37.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:37.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:37.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:37.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:38.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:38.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:38.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:38.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:39.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:39.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:39.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:39.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:40.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:40.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:40.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:40.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:41.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:41.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:41.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:41.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:42.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:42.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:42.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:42.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:43.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:43.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:44.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:44.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:44.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:44.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:45.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:44.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:45.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:45.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:46.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:46.037+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:46.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:46.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:47.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:47.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:47.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:47.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:48.133 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:48.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:48.548 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:48.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:49.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:49.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:49.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:49.529+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:50.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:50.121+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:50.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:50.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:51.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:51.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:51.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:51.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:52.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:52.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:52.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:52.593+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:53.173 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:53.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:53.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:53.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:54.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:54.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:54.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:54.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:55.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:55.101+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:55.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:55.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:56.145 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:56.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:56.510 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:56.501+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:57.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:57.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:57.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:57.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:58.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:58.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:58.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:58.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:59.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:38:59.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:38:59.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:38:59.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:00.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:00.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:00.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:00.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:01.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:01.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:01.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:01.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:02.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:02.252+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:02.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:02.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:03.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:03.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:03.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:03.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:04.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:04.212+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:04.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:04.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:05.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:05.164+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:05.536 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:05.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:06.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:06.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:06.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:06.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:07.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:07.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:07.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:07.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:08.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:08.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:08.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:08.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:09.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:09.228+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:09.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:09.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:10.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:10.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:10.517 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:10.508+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:11.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:11.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:11.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:11.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:12.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:12.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:12.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:12.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:13.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:13.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:13.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:13.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:14.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:14.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:14.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:14.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:15.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:15.280+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:15.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:15.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:16.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:16.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:16.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:16.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:17.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:17.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:17.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:17.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:18.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:18.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:18.618 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:18.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:19.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:19.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:19.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:19.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:20.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:20.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:20.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:20.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:21.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:21.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:21.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:21.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:22.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:22.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:22.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:22.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:23.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:23.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:23.675 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:23.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:24.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:24.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:24.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:24.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:25.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:25.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:25.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:25.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:26.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:26.264+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:26.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:26.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:27.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:27.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:27.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:27.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:28.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:28.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:28.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:28.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:29.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:29.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:29.604 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:29.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:30.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:30.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:30.652 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:30.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:31.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:31.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:31.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:31.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:32.198 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:32.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:32.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:32.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:33.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:33.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:33.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:33.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:34.115 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:34.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:34.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:34.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:35.155 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:35.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:35.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:35.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:36.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:36.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:36.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:36.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:37.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:37.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:37.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:37.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:38.149 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:38.140+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:38.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:38.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:39.146 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:39.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:39.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:39.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:40.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:40.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:40.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:40.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:41.142 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:41.131+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:41.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:41.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:42.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:42.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:42.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:42.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:43.110 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:43.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:43.746 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:43.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:44.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:44.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:44.787 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:44.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:45.109 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:45.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:45.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:45.759+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:46.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:46.123+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:46.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:46.779+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:47.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:47.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:47.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:47.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:48.154 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:48.143+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:48.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:48.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:49.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:49.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:49.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:49.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:50.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:50.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:50.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:50.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:51.127 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:51.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:51.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:51.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:52.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:52.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:52.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:52.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:53.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:53.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:53.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:53.875+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:54.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:54.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:54.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:54.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:55.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:55.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:55.842 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:55.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:56.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:56.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:56.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:56.879+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:57.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:57.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:57.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:57.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:58.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:58.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:58.859 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:58.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:59.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:39:59.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:39:59.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:39:59.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:00.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:00.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:00.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:00.887+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:01.168 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:01.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:01.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:01.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:02.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:02.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:02.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:02.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:03.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:03.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:03.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:03.831+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:04.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:04.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:04.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:04.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:05.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:05.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:05.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:05.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:06.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:06.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:06.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:06.859+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:07.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:07.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:07.881 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:07.871+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:08.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:08.159+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:08.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:08.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:09.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:09.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:09.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:09.907+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:10.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:10.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:10.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:10.891+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:11.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:11.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:11.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:11.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:12.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:12.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:12.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:12.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:13.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:13.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:13.806 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:13.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:14.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:14.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:14.822 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:14.811+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:15.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:15.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:15.803 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:15.795+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:16.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:16.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:16.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:16.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:17.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:17.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:17.830 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:17.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:18.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:18.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:18.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:18.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:19.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:19.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:19.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:19.883+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:20.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:20.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:20.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:20.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:21.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:21.334+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:21.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:21.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:22.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:22.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:22.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:22.930+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:23.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:23.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:23.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:23.890+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:24.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:24.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:24.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:24.878+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:25.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:25.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:25.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:25.862+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:26.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:26.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:26.855 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:26.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:27.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:27.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:27.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:27.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:28.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:28.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:28.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:28.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:29.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:29.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:29.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:29.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:30.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:30.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:30.851 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:30.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:31.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:31.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:31.867 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:31.858+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:32.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:32.338+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:32.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:32.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:33.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:33.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:33.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:33.834+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:34.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:34.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:34.823 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:34.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:35.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:35.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:35.837 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:35.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:36.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:36.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:36.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:36.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:37.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:37.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:37.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:37.886+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:38.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:38.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:38.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:38.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:39.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:39.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:39.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:39.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:40.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:40.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:40.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:40.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:41.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:41.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:41.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:41.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:42.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:42.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:42.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:42.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:43.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:43.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:43.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:43.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:44.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:44.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:44.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:44.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:45.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:45.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:45.925 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:45.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:46.483 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:46.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:46.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:46.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:47.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:47.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:48.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:48.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:48.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:48.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:48.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:48.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:49.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:49.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:49.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:49.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:50.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:50.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:50.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:50.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:51.471 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:51.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:51.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:51.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:52.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:52.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:52.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:52.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:53.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:53.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:53.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:53.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:54.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:54.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:54.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:54.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:55.418 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:55.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:55.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:55.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:56.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:56.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:56.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:56.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:57.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:57.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:57.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:57.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:58.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:58.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:58.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:58.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:59.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:40:59.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:40:59.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:40:59.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:00.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:00.342+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:00.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:00.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:01.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:01.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:01.888 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:01.882+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:02.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:02.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:02.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:02.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:03.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:03.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:03.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:03.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:04.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:04.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:04.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:04.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:05.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:05.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:05.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:05.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:06.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:06.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:06.887 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:06.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:07.422 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:07.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:07.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:07.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:08.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:08.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:08.918 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:08.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:09.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:09.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:09.885 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:09.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:10.405 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:10.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:10.899 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:10.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:11.454 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:11.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:11.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:11.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:12.445 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:12.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:12.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:12.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:13.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:13.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:13.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:13.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:14.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:14.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:14.871 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:14.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:15.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:15.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:15.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:15.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:16.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:16.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:16.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:16.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:17.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:17.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:17.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:17.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:18.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:18.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:18.870 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:18.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:19.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:19.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:19.890 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:19.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:20.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:20.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:20.850 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:20.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:21.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:21.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:21.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:21.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:22.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:22.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:22.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:22.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:23.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:23.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:23.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:23.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:24.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:24.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:24.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:24.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:25.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:25.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:25.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:25.793+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:26.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:26.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:26.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:26.789+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:27.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:27.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:27.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:27.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:28.283 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:28.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:28.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:28.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:29.310 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:29.305+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:29.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:29.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:30.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:30.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:30.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:30.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:31.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:31.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:31.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:31.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:32.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:32.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:32.698 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:32.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:33.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:33.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:33.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:33.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:34.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:34.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:34.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:34.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:35.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:35.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:35.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:35.657+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:36.271 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:36.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:36.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:36.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:37.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:37.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:37.730 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:37.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:38.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:38.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:38.781 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:38.773+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:39.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:39.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:39.736 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:39.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:40.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:40.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:40.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:40.709+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:41.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:41.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:41.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:41.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:42.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:42.189+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:42.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:42.725+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:43.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:43.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:43.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:43.749+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:44.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:44.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:44.748 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:44.740+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:45.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:45.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:45.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:45.720+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:46.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:46.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:46.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:46.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:47.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:47.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:47.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:47.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:48.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:48.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:48.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:48.696+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:49.326 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:49.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:49.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:49.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:50.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:50.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:50.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:50.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:51.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:51.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:51.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:51.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:52.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:52.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:52.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:52.712+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:53.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:53.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:53.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:53.716+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:54.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:54.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:54.686 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:54.676+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:55.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:55.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:55.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:55.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:56.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:56.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:56.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:56.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:57.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:57.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:57.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:57.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:58.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:58.408+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:58.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:58.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:59.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:41:59.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:41:59.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:41:59.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:00.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:00.352+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:00.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:00.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:01.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:01.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:01.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:01.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:02.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:02.336+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:02.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:02.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:03.333 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:03.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:03.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:03.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:04.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:04.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:04.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:04.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:05.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:05.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:05.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:05.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:06.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:06.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:06.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:06.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:07.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:07.372+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:07.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:07.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:08.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:08.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:08.582 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:08.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:09.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:09.304+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:09.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:09.532+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:10.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:10.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:10.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:10.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:11.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:11.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:11.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:11.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:12.398 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:12.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:12.484 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:12.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:13.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:13.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:13.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:13.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:14.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:14.364+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:14.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:14.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:15.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:15.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:15.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:15.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:16.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:16.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:16.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:16.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:17.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:17.388+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:17.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:17.432+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:18.447 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:18.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:18.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:18.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:19.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:19.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:19.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:19.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:20.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:20.400+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:20.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:20.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:21.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:21.404+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:21.476 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:21.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:22.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:22.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:22.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:22.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:23.331 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:23.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:23.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:23.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:24.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:24.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:24.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:24.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:25.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:25.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:25.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:25.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:26.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:26.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:26.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:26.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:27.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:27.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:27.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:27.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:28.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:28.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:28.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:28.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:29.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:29.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:29.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:29.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:30.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:30.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:30.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:30.503+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:31.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:31.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:31.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:31.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:32.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:32.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:32.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:32.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:33.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:33.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:33.485 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:33.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:34.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:34.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:34.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:34.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:35.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:35.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:35.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:35.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:36.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:36.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:36.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:36.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:37.312 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:37.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:37.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:37.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:38.353 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:38.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:38.480 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:38.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:39.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:39.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:39.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:39.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:40.344 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:40.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:40.531 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:40.523+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:41.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:41.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:41.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:41.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:42.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:42.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:42.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:42.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:43.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:43.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:43.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:43.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:44.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:44.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:44.574 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:44.563+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:45.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:45.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:45.557 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:45.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:46.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:46.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:46.520 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:46.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:47.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:47.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:47.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:47.527+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:48.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:48.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:48.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:48.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:49.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:49.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:49.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:49.539+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:50.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:50.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:50.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:50.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:51.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:51.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:51.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:51.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:52.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:52.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:52.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:52.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:53.346 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:53.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:53.440 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:53.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:54.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:54.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:54.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:54.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:55.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:55.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:55.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:55.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:56.374 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:56.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:56.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:56.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:57.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:57.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:57.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:57.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:58.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:58.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:58.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:58.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:59.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:42:59.343+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:42:59.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:42:59.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:00.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:00.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:00.524 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:00.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:01.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:01.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:01.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:01.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:02.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:02.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:02.553 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:02.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:03.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:03.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:03.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:03.591+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:04.320 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:04.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:04.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:04.603+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:05.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:05.271+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:05.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:05.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:06.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:06.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:06.670 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:06.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:07.287 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:07.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:07.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:07.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:08.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:08.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:08.747 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:08.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:09.325 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:09.314+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:09.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:09.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:10.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:10.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:10.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:10.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:11.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:11.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:11.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:11.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:12.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:12.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:12.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:12.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:13.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:13.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:13.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:13.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:14.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:14.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:14.795 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:14.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:15.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:15.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:15.841 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:15.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:16.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:16.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:16.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:16.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:17.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:17.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:17.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:17.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:18.442 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:18.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:18.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:18.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:19.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:19.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:19.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:19.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:20.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:20.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:20.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:20.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:21.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:21.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:21.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:21.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:22.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:22.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:22.797 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:22.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:23.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:23.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:23.819 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:23.814+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:24.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:24.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:24.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:24.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:25.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:25.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:25.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:25.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:26.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:26.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:26.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:26.850+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:27.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:27.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:27.844 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:27.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:28.360 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:28.354+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:28.877 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:28.870+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:29.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:29.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:29.838 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:29.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:30.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:30.326+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:30.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:30.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:31.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:31.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:31.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:31.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:32.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:32.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:32.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:32.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:33.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:33.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:33.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:33.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:34.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:34.330+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:34.800 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:34.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:35.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:35.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:35.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:35.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:36.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:36.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:36.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:36.846+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:37.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:37.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:37.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:37.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:38.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:38.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:38.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:38.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:39.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:39.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:39.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:39.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:40.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:40.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:40.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:40.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:41.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:41.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:41.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:41.806+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:42.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:42.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:42.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:42.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:43.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:43.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:43.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:43.818+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:44.366 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:44.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:44.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:44.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:45.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:45.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:45.816 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:45.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:46.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:46.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:46.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:46.842+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:47.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:47.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:47.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:47.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:48.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:48.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:48.898 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:48.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:49.463 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:49.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:49.862 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:49.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:50.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:50.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:50.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:50.845+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:51.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:51.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:51.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:51.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:52.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:52.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:52.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:52.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:53.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:53.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:53.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:53.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:54.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:54.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:54.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:54.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:55.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:55.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:55.901 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:55.893+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:56.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:56.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:56.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:56.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:57.495 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:57.489+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:57.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:57.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:58.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:58.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:58.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:58.857+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:59.509 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:43:59.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:43:59.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:43:59.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:00.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:00.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:00.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:00.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:01.550 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:01.541+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:01.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:01.865+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:02.577 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:02.569+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:02.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:02.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:03.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:03.601+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:03.946 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:03.941+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:04.570 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:04.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:04.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:04.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:05.619 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:05.613+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:06.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:05.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:06.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:06.565+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:06.987 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:06.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:07.539 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:07.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:07.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:07.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:08.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:08.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:08.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:08.961+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:09.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:09.537+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:09.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:09.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:10.583 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:10.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:10.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:10.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:11.635 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:11.629+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:12.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:12.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:12.614 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:12.605+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:12.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:12.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:13.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:13.637+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:13.982 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:13.977+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:14.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:14.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:14.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:14.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:15.711 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:15.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:16.024 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:16.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:16.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:16.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:17.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:17.021+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:17.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:17.641+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:18.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:18.073+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:18.669 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:18.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:19.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:19.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:19.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:19.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:20.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:20.137+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:20.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:20.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:21.150 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:21.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:21.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:21.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:22.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:22.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:22.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:22.745+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:23.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:23.189+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:23.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:23.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:24.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:24.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:24.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:24.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:25.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:25.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:25.692 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:25.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:26.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:26.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:26.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:26.693+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:27.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:27.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:27.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:27.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:28.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:28.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:28.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:28.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:29.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:29.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:29.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:29.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:30.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:30.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:30.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:30.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:31.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:31.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:31.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:31.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:32.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:32.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:32.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:32.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:33.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:33.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:33.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:33.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:34.244 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:34.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:34.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:34.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:35.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:35.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:35.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:35.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:36.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:36.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:36.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:36.844+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:37.217 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:37.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:37.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:37.824+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:38.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:38.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:38.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:38.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:39.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:39.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:39.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:39.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:40.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:40.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:40.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:40.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:41.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:41.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:41.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:41.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:42.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:42.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:42.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:42.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:43.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:43.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:43.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:43.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:44.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:44.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:44.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:44.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:45.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:45.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:45.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:45.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:46.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:46.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:46.970 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:46.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:47.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:47.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:47.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:47.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:48.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:48.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:48.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:48.972+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:49.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:49.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:49.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:49.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:50.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:50.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:50.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:50.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:51.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:51.120+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:51.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:51.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:52.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:52.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:52.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:52.928+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:53.064 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:53.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:53.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:53.976+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:54.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:54.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:54.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:54.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:55.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:55.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:56.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:56.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:56.116 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:56.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:56.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:56.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:57.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:57.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:57.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:57.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:58.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:58.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:58.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:58.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:59.153 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:44:59.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:44:59.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:44:59.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:00.193 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:00.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:00.989 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:00.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:01.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:01.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:01.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:01.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:02.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:02.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:02.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:02.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:03.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:03.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:03.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:03.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:04.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:04.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:04.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:04.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:05.113 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:05.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:05.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:05.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:06.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:06.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:06.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:06.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:07.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:07.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:07.847 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:07.840+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:08.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:08.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:08.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:08.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:09.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:09.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:09.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:09.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:10.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:10.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:10.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:10.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:11.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:11.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:11.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:11.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:12.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:12.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:12.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:12.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:13.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:13.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:13.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:13.767+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:14.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:14.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:14.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:14.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:15.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:15.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:15.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:15.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:16.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:16.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:16.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:16.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:17.098 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:17.087+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:17.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:17.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:18.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:18.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:18.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:18.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:19.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:19.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:19.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:19.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:20.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:20.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:20.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:20.843+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:21.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:21.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:21.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:21.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:22.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:22.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:22.855 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:22.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:23.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:23.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:23.831 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:23.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:24.190 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:24.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:24.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:24.799+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:25.160 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:25.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:25.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:25.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:26.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:26.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:26.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:26.815+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:27.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:27.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:27.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:27.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:28.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:28.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:28.799 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:28.791+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:29.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:29.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:29.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:29.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:30.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:30.147+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:30.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:30.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:31.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:31.107+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:31.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:31.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:32.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:32.091+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:32.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:32.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:33.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:33.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:33.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:33.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:34.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:34.115+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:34.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:34.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:35.078 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:35.071+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:35.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:35.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:36.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:36.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:36.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:36.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:37.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:37.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:37.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:37.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:38.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:38.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:38.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:38.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:39.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:39.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:39.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:39.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:40.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:40.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:40.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:40.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:40.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:40.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:41.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:41.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:41.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:41.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:42.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:42.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:42.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:42.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:43.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:43.907+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:44.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:44.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:44.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:44.903+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:45.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:45.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:45.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:45.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:46.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:46.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:46.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:46.835+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:47.052 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:47.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:47.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:47.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:48.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:48.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:48.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:48.923+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:49.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:49.103+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:49.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:49.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:50.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:50.155+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:50.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:50.891+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:51.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:51.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:51.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:51.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:52.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:52.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:52.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:52.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:53.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:53.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:53.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:53.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:54.245 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:54.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:54.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:54.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:55.197 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:55.186+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:55.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:55.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:56.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:56.154+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:56.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:56.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:57.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:57.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:57.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:57.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:58.214 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:58.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:58.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:58.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:59.228 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:45:59.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:45:59.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:45:59.918+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:00.192 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:00.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:00.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:00.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:01.146 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:01.134+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:01.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:01.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:02.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:02.170+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:02.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:02.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:03.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:03.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:03.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:03.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:04.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:04.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:04.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:04.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:05.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:05.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:05.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:05.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:06.138 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:06.130+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:06.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:06.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:07.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:07.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:07.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:07.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:08.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:08.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:08.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:08.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:09.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:09.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:09.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:09.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:10.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:10.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:10.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:10.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:11.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:11.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:11.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:11.874+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:12.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:12.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:12.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:12.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:13.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:13.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:13.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:13.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:14.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:14.114+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:14.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:14.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:15.164 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:15.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:15.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:15.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:16.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:16.206+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:16.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:16.934+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:17.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:17.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:17.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:17.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:18.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:18.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:18.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:18.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:19.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:19.178+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:20.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:20.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:20.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:20.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:20.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:20.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:21.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:21.166+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:22.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:21.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:22.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:22.174+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:22.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:22.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:23.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:23.182+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:23.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:23.962+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:24.233 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:24.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:24.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:24.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:25.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:25.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:25.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:25.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:26.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:26.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:26.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:26.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:27.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:27.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:28.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:28.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:28.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:28.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:29.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:29.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:29.229 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:29.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:30.016 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:30.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:30.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:30.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:31.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:31.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:31.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:31.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:32.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:32.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:32.263 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:32.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:33.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:33.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:33.277 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:33.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:34.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:34.066+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:34.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:34.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:35.075 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:35.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:35.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:35.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:36.033 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:36.025+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:36.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:36.297+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:37.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:37.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:37.285 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:37.277+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:37.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:37.977+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:38.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:38.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:38.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:38.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:39.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:39.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:39.998 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:39.989+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:40.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:40.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:40.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:40.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:41.318 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:41.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:41.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:41.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:42.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:42.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:42.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:42.981+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:43.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:43.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:44.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:44.009+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:44.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:44.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:44.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:44.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:45.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:45.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:46.020 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:46.013+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:46.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:46.237+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:47.058 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:47.049+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:47.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:47.201+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:48.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:48.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:48.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:48.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:49.084 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:49.077+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:49.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:49.181+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:50.104 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:50.097+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:50.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:50.145+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:51.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:51.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:51.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:51.133+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:52.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:52.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:52.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:52.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:53.114 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:53.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:53.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:53.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:54.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:54.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:54.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:54.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:55.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:55.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:55.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:55.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:56.148 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:56.141+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:56.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:56.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:57.153 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:57.145+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:57.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:57.233+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:58.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:58.197+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:58.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:58.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:59.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:46:59.149+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:46:59.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:46:59.185+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:00.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:00.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:00.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:00.165+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:01.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:01.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:01.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:01.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:02.102 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:02.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:02.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:02.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:03.087 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:03.081+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:03.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:03.181+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:04.101 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:04.093+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:04.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:04.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:05.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:05.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:05.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:05.157+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:06.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:06.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:06.169 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:06.161+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:07.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:07.133+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:07.174 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:07.165+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:08.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:08.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:08.156 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:08.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:09.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:09.125+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:09.183 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:09.177+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:10.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:10.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:10.177 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:10.169+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:11.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:11.137+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:11.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:11.157+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:12.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:12.149+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:12.159 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:12.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:13.112 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:13.105+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:13.124 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:13.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:14.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:14.089+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:14.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:14.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:15.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:15.097+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:15.123 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:15.117+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:16.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:16.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:16.116 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:16.108+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:17.059 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:17.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:17.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:17.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:18.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:18.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:18.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:18.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:19.096 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:19.088+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:19.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:19.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:20.061 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:20.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:20.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:20.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:21.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:21.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:21.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:21.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:22.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:22.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:22.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:22.140+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:23.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:23.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:23.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:23.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:24.001 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:23.992+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:24.104 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:24.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:24.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:24.956+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:25.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:25.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:25.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:25.960+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:26.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:26.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:27.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:27.012+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:27.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:27.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:28.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:27.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:28.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:28.076+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:29.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:29.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:29.120 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:29.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:30.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:30.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:30.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:30.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:31.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:31.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:31.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:31.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:32.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:32.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:32.195 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:32.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:33.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:33.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:33.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:33.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:34.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:34.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:34.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:34.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:35.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:35.052+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:35.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:35.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:36.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:36.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:36.198 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:36.188+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:37.105 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:37.096+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:37.172 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:37.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:38.085 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:38.076+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:38.211 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:38.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:39.088 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:39.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:39.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:39.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:40.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:40.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:40.173 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:40.164+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:41.046 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:41.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:41.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:41.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:42.078 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:42.068+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:42.242 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:42.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:43.044 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:43.036+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:43.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:43.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:44.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:44.004+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:44.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:44.208+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:45.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:45.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:45.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:45.192+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:46.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:45.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:46.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:46.160+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:47.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:47.008+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:47.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:47.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:48.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:48.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:48.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:48.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:48.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:48.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:49.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:49.204+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:49.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:49.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:50.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:50.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:50.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:50.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:51.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:51.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:51.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:51.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:52.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:52.232+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:53.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:52.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:53.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:53.212+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:54.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:54.028+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:54.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:54.184+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:54.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:54.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:55.207 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:55.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:56.003 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:55.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:56.184 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:56.176+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:57.040 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:57.032+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:57.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:57.216+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:58.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:58.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:58.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:58.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:59.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:47:59.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:47:59.188 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:47:59.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:00.054 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:00.043+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:00.178 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:00.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:01.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:01.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:01.169 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:01.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:02.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:02.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:02.165 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:02.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:03.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:03.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:03.187 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:03.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:04.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:04.067+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:04.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:04.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:05.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:05.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:05.107 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:05.099+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:06.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:06.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:06.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:06.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:07.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:07.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:07.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:07.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:08.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:08.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:08.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:08.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:09.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:09.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:09.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:09.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:10.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:10.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:10.210 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:10.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:11.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:11.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:11.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:11.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:12.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:12.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:12.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:12.267+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:13.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:13.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:13.313 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:13.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:14.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:14.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:14.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:14.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:15.041 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:15.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:15.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:15.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:16.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:16.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:16.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:16.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:17.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:17.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:17.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:17.447+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:18.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:18.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:18.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:18.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:19.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:19.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:19.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:19.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:20.047 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:20.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:20.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:20.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:21.062 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:21.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:21.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:21.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:22.082 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:22.071+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:22.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:22.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:23.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:23.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:23.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:23.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:24.099 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:24.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:24.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:24.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:25.136 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:25.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:25.399 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:25.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:26.150 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:26.139+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:26.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:26.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:27.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:27.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:27.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:27.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:28.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:28.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:28.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:28.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:29.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:29.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:29.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:29.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:30.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:30.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:30.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:30.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:31.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:31.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:31.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:31.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:32.341 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:32.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:32.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:32.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:33.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:33.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:33.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:33.395+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:34.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:34.371+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:34.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:34.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:35.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:35.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:35.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:35.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:36.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:36.363+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:36.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:36.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:37.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:37.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:37.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:37.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:38.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:38.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:38.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:38.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:39.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:39.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:39.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:39.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:40.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:40.346+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:40.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:40.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:41.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:41.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:41.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:41.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:42.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:42.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:42.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:42.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:43.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:43.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:43.468 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:43.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:44.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:44.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:44.514 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:44.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:45.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:45.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:45.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:45.498+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:46.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:46.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:46.491 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:46.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:47.401 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:47.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:47.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:47.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:48.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:48.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:48.490 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:48.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:49.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:49.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:49.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:49.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:50.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:50.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:50.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:50.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:51.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:51.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:51.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:51.474+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:52.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:52.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:52.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:52.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:53.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:53.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:53.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:53.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:54.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:54.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:54.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:54.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:55.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:55.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:55.442 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:55.434+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:56.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:56.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:56.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:56.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:57.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:57.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:57.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:57.426+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:58.427 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:58.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:58.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:58.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:59.396 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:48:59.390+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:48:59.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:48:59.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:00.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:00.382+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:00.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:00.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:01.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:01.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:01.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:01.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:02.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:02.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:02.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:02.454+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:03.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:03.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:03.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:03.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:04.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:04.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:04.540 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:04.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:05.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:05.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:05.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:05.582+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:06.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:06.286+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:06.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:06.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:07.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:07.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:07.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:07.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:08.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:08.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:08.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:08.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:09.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:09.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:09.607 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:09.602+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:10.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:10.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:10.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:10.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:11.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:11.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:11.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:11.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:12.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:12.274+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:12.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:12.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:13.287 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:13.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:13.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:13.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:14.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:14.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:14.556 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:14.550+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:15.221 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:15.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:15.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:15.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:16.201 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:16.194+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:16.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:16.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:17.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:17.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:17.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:17.502+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:18.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:18.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:18.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:18.482+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:19.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:19.210+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:19.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:19.458+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:20.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:20.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:20.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:20.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:21.235 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:21.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:21.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:21.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:22.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:22.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:22.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:22.437+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:23.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:23.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:23.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:23.485+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:24.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:24.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:24.462 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:24.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:25.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:25.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:25.500 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:25.493+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:26.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:26.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:26.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:26.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:27.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:27.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:27.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:27.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:28.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:28.225+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:28.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:28.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:29.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:29.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:29.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:29.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:30.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:30.213+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:30.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:30.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:31.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:31.173+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:31.428 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:31.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:32.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:32.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:32.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:32.397+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:33.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:33.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:33.426 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:33.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:34.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:34.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:34.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:34.453+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:35.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:35.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:35.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:35.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:36.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:36.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:36.478 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:36.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:37.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:37.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:37.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:37.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:38.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:38.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:38.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:38.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:39.294 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:39.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:39.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:39.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:40.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:40.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:40.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:40.457+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:41.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:41.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:41.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:41.469+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:42.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:42.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:42.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:42.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:43.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:43.229+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:43.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:43.513+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:44.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:44.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:44.487 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:44.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:45.223 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:45.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:45.536 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:45.529+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:46.215 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:46.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:46.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:46.517+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:47.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:47.241+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:47.533 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:47.525+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:48.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:48.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:48.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:48.477+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:49.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:49.265+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:49.507 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:49.501+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:50.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:50.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:50.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:50.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:51.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:51.333+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:51.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:51.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:52.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:52.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:52.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:52.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:53.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:53.357+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:53.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:53.481+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:54.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:54.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:54.469 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:54.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:55.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:55.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:55.517 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:55.509+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:56.347 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:56.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:56.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:56.497+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:57.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:57.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:57.481 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:57.473+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:58.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:58.309+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:58.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:58.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:59.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:49:59.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:49:59.530 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:49:59.521+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:00.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:00.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:00.542 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:00.533+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:01.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:01.365+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:01.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:01.577+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:02.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:02.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:02.629 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:02.620+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:03.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:03.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:03.648 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:03.640+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:04.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:04.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:04.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:04.628+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:05.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:05.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:05.655 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:05.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:06.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:06.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:06.667 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:06.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:07.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:07.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:07.675 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:07.668+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:08.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:08.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:08.717 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:08.708+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:09.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:09.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:09.683 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:09.672+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:10.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:10.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:10.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:10.648+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:11.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:11.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:11.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:11.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:12.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:12.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:12.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:12.660+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:13.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:13.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:13.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:13.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:14.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:14.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:14.735 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:14.728+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:15.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:15.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:15.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:15.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:16.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:16.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:16.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:16.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:17.572 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:17.564+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:17.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:17.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:18.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:18.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:18.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:18.688+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:19.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:19.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:19.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:19.696+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:20.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:20.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:20.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:20.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:21.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:21.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:21.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:21.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:22.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:22.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:22.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:22.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:23.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:23.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:23.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:23.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:24.651 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:24.644+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:24.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:24.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:25.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:25.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:25.828 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:25.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:26.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:26.660+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:26.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:26.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:27.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:27.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:27.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:27.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:28.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:28.684+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:28.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:28.876+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:29.660 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:29.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:29.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:29.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:30.708 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:30.700+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:30.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:30.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:31.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:31.748+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:31.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:31.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:32.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:32.776+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:32.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:32.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:33.824 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:33.816+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:33.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:33.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:34.799 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:34.788+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:34.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:34.936+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:35.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:35.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:35.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:35.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:36.853 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:36.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:36.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:36.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:37.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:37.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:37.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:37.924+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:38.900 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:38.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:38.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:38.932+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:39.864 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:39.856+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:39.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:39.980+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:40.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:40.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:40.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:40.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:41.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:41.800+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:42.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:42.024+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:42.766 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:42.756+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:43.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:43.048+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:43.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:43.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:44.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:44.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:44.761 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:44.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:45.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:45.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:45.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:45.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:46.071 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:46.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:46.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:46.719+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:47.064 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:47.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:47.691 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:47.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:48.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:48.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:48.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:48.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:49.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:49.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:49.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:49.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:50.050 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:50.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:50.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:50.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:51.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:51.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:51.717 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:51.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:52.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:52.115+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:52.762 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:52.751+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:53.094 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:53.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:53.732 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:53.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:54.137 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:54.127+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:54.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:54.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:55.184 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:55.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:55.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:55.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:56.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:56.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:56.693 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:56.683+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:57.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:57.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:57.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:57.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:58.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:58.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:58.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:58.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:59.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:50:59.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:50:59.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:50:59.639+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:00.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:00.231+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:00.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:00.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:01.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:01.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:01.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:01.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:02.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:02.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:02.645 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:02.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:03.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:03.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:03.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:03.627+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:04.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:04.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:04.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:04.599+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:05.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:05.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:05.639 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:05.631+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:06.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:06.235+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:06.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:06.587+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:07.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:07.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:07.566 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:07.555+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:08.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:08.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:08.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:08.547+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:09.369 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:09.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:09.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:09.543+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:10.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:10.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:10.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:10.495+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:11.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:11.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:11.498 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:11.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:12.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:12.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:12.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:12.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:13.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:13.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:13.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:13.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:14.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:14.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:14.516 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:14.507+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:15.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:15.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:15.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:15.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:16.417 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:16.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:16.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:16.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:17.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:17.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:17.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:17.511+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:18.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:18.415+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:18.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:18.475+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:19.450 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:19.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:19.460 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:19.451+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:20.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:20.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:20.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:20.439+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:21.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:21.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:21.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:21.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:22.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:22.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:22.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:22.531+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:23.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:23.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:23.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:23.579+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:24.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:24.363+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:24.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:24.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:25.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:25.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:25.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:25.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:26.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:26.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:26.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:26.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:27.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:27.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:27.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:27.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:28.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:28.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:28.685 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:28.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:29.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:29.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:29.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:29.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:30.475 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:30.466+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:30.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:30.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:31.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:31.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:31.712 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:31.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:32.461 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:32.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:32.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:32.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:33.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:33.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:33.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:33.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:34.488 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:34.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:34.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:34.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:35.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:35.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:35.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:35.666+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:36.485 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:36.478+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:36.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:36.694+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:37.458 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:37.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:37.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:37.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:38.420 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:38.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:38.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:38.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:39.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:39.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:39.728 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:39.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:40.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:40.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:40.726 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:40.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:41.352 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:41.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:41.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:41.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:42.395 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:42.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:42.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:42.702+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:43.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:43.350+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:43.714 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:43.706+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:44.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:44.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:44.694 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:44.686+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:45.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:45.418+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:45.703 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:45.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:46.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:46.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:46.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:46.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:47.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:47.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:47.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:47.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:48.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:48.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:48.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:48.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:49.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:49.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:49.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:49.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:50.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:50.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:50.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:50.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:51.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:51.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:51.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:51.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:52.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:52.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:52.727 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:52.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:53.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:53.438+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:53.687 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:53.682+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:54.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:54.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:54.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:54.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:55.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:55.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:55.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:55.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:56.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:56.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:56.607 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:56.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:57.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:57.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:57.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:57.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:58.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:58.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:58.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:58.578+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:59.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:51:59.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:51:59.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:51:59.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:00.414 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:00.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:00.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:00.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:01.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:01.450+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:01.526 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:01.518+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:02.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:02.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:02.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:02.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:03.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:03.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:03.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:03.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:04.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:04.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:04.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:04.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:05.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:05.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:05.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:05.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:06.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:06.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:06.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:06.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:07.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:07.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:07.540 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:07.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:08.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:08.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:08.554 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:08.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:09.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:09.313+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:09.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:09.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:10.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:10.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:10.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:10.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:11.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:11.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:11.522 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:11.513+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:12.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:12.413+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:12.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:12.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:13.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:13.389+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:13.528 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:13.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:14.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:14.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:14.561 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:14.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:15.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:15.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:15.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:15.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:16.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:16.441+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:16.590 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:16.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:17.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:17.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:17.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:17.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:18.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:18.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:18.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:18.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:19.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:19.337+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:19.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:19.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:20.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:20.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:20.551 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:20.545+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:21.294 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:21.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:21.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:21.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:22.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:22.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:22.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:22.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:23.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:23.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:23.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:23.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:24.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:24.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:24.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:24.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:25.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:25.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:25.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:25.625+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:26.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:26.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:26.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:26.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:27.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:27.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:27.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:27.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:28.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:28.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:28.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:28.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:29.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:29.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:29.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:29.677+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:30.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:30.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:30.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:30.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:31.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:31.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:31.606 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:31.597+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:32.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:32.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:32.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:32.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:33.291 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:33.285+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:33.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:33.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:34.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:34.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:34.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:34.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:35.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:35.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:35.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:35.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:36.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:36.241+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:36.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:36.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:37.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:37.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:37.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:37.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:38.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:38.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:38.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:38.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:39.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:39.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:39.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:39.541+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:40.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:40.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:40.542 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:40.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:41.238 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:41.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:41.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:41.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:42.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:42.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:42.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:42.609+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:43.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:43.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:43.593 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:43.585+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:44.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:44.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:44.620 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:44.613+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:45.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:45.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:45.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:45.605+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:46.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:46.289+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:46.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:46.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:47.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:47.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:47.565 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:47.557+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:48.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:48.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:48.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:48.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:49.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:49.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:49.563 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:49.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:50.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:50.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:50.612 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:50.604+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:51.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:51.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:51.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:51.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:52.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:52.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:52.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:52.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:53.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:53.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:53.579 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:53.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:54.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:54.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:54.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:54.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:55.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:55.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:55.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:55.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:56.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:56.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:56.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:56.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:57.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:57.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:57.655 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:57.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:58.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:58.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:58.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:58.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:59.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:52:59.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:52:59.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:52:59.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:00.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:00.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:00.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:00.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:01.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:01.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:01.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:01.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:02.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:02.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:02.688 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:02.680+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:03.204 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:03.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:03.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:03.652+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:04.165 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:04.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:04.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:04.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:05.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:05.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:05.622 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:05.612+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:06.122 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:06.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:06.588 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:06.580+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:07.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:07.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:07.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:07.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:08.132 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:08.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:08.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:08.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:09.160 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:09.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:09.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:09.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:10.179 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:10.168+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:10.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:10.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:11.170 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:11.160+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:11.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:11.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:12.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:12.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:12.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:12.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:13.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:13.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:13.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:13.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:14.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:14.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:14.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:14.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:15.250 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:15.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:15.619 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:15.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:16.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:16.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:16.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:16.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:17.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:17.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:17.702 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:17.692+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:18.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:18.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:18.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:18.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:19.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:19.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:19.637 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:19.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:20.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:20.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:20.649 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:20.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:21.199 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:21.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:21.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:21.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:22.162 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:22.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:22.610 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:22.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:23.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:23.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:23.600 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:23.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:24.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:24.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:24.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:24.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:25.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:25.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:25.550 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:25.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:26.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:26.284+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:26.535 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:26.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:27.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:27.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:27.581 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:27.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:28.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:28.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:28.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:28.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:29.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:29.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:29.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:29.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:30.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:30.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:30.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:30.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:31.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:31.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:31.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:31.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:32.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:32.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:32.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:32.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:33.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:33.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:33.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:33.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:34.260 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:34.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:34.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:34.647+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:35.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:35.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:35.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:35.643+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:36.286 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:36.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:36.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:36.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:37.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:37.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:37.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:37.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:38.285 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:38.275+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:38.699 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:38.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:39.247 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:39.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:39.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:39.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:40.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:40.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:40.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:40.775+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:41.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:41.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:41.813 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:41.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:42.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:42.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:42.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:42.835+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:43.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:43.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:43.836 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:43.827+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:44.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:44.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:44.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:44.867+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:45.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:45.359+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:45.872 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:45.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:46.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:46.411+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:46.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:46.839+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:47.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:47.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:47.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:47.823+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:48.365 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:48.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:48.852 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:48.843+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:49.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:49.407+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:49.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:49.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:50.387 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:50.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:50.810 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:50.799+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:51.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:51.403+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:51.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:51.815+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:52.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:52.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:52.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:52.863+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:53.450 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:53.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:53.904 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:53.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:54.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:54.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:54.866 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:54.855+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:55.472 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:55.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:55.829 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:55.819+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:56.522 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:56.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:56.814 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:56.803+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:57.504 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:57.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:57.861 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:57.851+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:58.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:58.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:58.906 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:58.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:59.524 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:53:59.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:53:59.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:53:59.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:00.545 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:00.535+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:00.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:00.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:01.591 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:01.583+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:01.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:01.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:02.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:02.563+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:02.908 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:02.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:03.559 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:03.551+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:03.929 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:03.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:04.515 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:04.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:04.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:04.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:05.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:05.463+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:05.992 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:05.983+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:06.510 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:06.499+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:06.978 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:06.967+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:07.470 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:07.459+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:07.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:07.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:08.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:08.475+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:08.932 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:08.923+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:09.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:09.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:09.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:09.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:10.480 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:10.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:10.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:10.903+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:11.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:11.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:11.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:11.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:12.404 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:12.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:12.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:12.914+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:13.413 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:13.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:13.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:13.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:14.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:14.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:14.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:14.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:15.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:15.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:15.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:15.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:16.370 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:16.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:16.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:16.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:17.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:17.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:17.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:17.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:18.289 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:18.278+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:18.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:18.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:19.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:19.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:20.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:19.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:20.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:20.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:20.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:20.986+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:21.322 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:21.310+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:22.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:22.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:22.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:22.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:22.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:22.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:23.308 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:23.302+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:24.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:24.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:24.282 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:24.274+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:25.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:25.034+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:25.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:25.318+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:26.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:26.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:26.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:26.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:27.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:27.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:27.375 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:27.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:28.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:28.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:28.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:28.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:29.083 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:29.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:29.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:29.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:30.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:30.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:30.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:30.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:31.081 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:31.074+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:31.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:31.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:32.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:32.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:32.408 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:32.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:33.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:33.158+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:33.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:33.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:34.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:34.150+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:34.439 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:34.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:35.132 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:35.126+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:35.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:35.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:36.095 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:36.090+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:36.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:36.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:37.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:37.066+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:37.419 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:37.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:38.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:38.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:38.403 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:38.398+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:39.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:39.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:39.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:39.382+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:40.089 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:40.082+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:40.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:40.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:41.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:41.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:41.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:41.402+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:42.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:42.062+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:42.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:42.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:43.066 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:43.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:43.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:43.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:44.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:44.058+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:44.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:44.446+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:45.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:45.046+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:45.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:45.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:46.075 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:46.070+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:46.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:46.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:47.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:47.110+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:47.401 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:47.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:48.086 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:48.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:48.421 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:48.414+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:49.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:49.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:49.411 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:49.406+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:50.043 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:50.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:50.393 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:50.386+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:51.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:51.018+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:51.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:51.358+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:52.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:52.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:52.351 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:52.346+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:52.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:52.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:53.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:53.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:54.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:54.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:54.263 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:54.257+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:54.977 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:54.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:55.235 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:55.229+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:56.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:56.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:56.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:56.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:56.976 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:56.969+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:57.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:57.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:58.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:58.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:58.279 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:58.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:59.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:54:59.017+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:54:59.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:54:59.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:00.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:00.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:00.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:00.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:01.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:01.033+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:01.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:01.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:02.084 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:02.077+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:02.290 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:02.281+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:03.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:03.085+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:03.324 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:03.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:04.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:04.125+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:04.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:04.361+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:05.151 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:05.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:05.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:05.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:06.167 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:06.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:06.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:06.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:07.218 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:07.209+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:07.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:07.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:08.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:08.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:08.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:08.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:09.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:09.253+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:09.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:09.401+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:10.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:10.261+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:10.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:10.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:11.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:11.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:11.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:11.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:12.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:12.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:12.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:12.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:13.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:13.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:13.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:13.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:14.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:14.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:14.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:14.381+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:15.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:15.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:15.422 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:15.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:16.381 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:16.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:16.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:16.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:17.380 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:17.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:17.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:17.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:18.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:18.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:18.513 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:18.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:19.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:19.385+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:19.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:19.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:20.384 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:20.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:20.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:20.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:21.412 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:21.405+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:21.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:21.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:22.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:22.357+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:22.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:22.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:23.342 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:23.333+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:23.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:23.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:24.388 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:24.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:24.482 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:24.473+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:25.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:25.425+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:25.449 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:25.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:26.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:26.445+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:26.461 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:26.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:27.415 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:27.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:27.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:27.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:28.376 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:28.369+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:28.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:28.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:29.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:29.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:29.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:29.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:30.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:30.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:30.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:30.437+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:31.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:31.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:31.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:31.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:32.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:32.317+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:32.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:32.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:33.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:33.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:33.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:33.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:34.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:34.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:34.412 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:34.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:35.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:35.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:35.385 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:35.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:36.330 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:36.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:36.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:36.404+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:37.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:37.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:37.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:37.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:38.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:38.376+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:38.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:38.452+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:39.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:39.392+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:39.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:39.412+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:40.368 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:40.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:40.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:40.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:41.358 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:41.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:41.410 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:41.400+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:42.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:42.368+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:42.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:42.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:43.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:43.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:43.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:43.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:44.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:44.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:44.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:44.436+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:45.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:45.324+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:45.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:45.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:46.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:46.308+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:46.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:46.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:47.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:47.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:47.455 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:47.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:48.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:48.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:48.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:48.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:49.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:49.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:49.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:49.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:50.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:50.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:50.393 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:50.384+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:51.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:51.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:51.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:51.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:52.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:52.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:52.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:52.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:53.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:53.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:53.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:53.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:54.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:54.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:54.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:54.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:55.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:55.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:55.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:55.440+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:56.406 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:56.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:56.440 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:56.432+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:57.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:57.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:57.431 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:57.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:58.425 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:58.416+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:58.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:58.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:59.426 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:55:59.416+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:55:59.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:55:59.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:00.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:00.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:00.516 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:00.508+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:01.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:01.368+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:01.551 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:01.544+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:02.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:02.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:02.520 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:02.512+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:03.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:03.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:03.532 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:03.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:04.365 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:04.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:04.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:04.524+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:05.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:05.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:05.585 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:05.576+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:06.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:06.344+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:06.561 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:06.552+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:07.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:07.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:07.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:07.520+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:08.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:08.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:08.508 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:08.500+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:09.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:09.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:09.501 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:09.492+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:10.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:10.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:10.466 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:10.456+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:11.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:11.300+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:11.498 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:11.488+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:12.270 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:12.260+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:12.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:12.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:13.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:13.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:13.457 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:13.448+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:14.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:14.336+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:14.459 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:14.452+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:15.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:15.316+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:15.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:15.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:16.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:16.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:16.436 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:16.427+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:17.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:17.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:17.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:17.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:18.322 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:18.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:18.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:18.439+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:19.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:19.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:19.434 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:19.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:20.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:20.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:20.477 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:20.467+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:21.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:21.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:21.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:21.443+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:22.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:22.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:22.499 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:22.491+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:23.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:23.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:23.519 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:23.511+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:24.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:24.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:24.505 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:24.495+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:25.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:25.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:25.529 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:25.519+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:26.310 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:26.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:26.482 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:26.471+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:27.284 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:27.275+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:27.518 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:27.507+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:28.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:28.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:28.523 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:28.515+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:29.264 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:29.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:29.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:29.483+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:30.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:30.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:30.456 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:30.447+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:31.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:31.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:31.432 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:31.423+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:32.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:32.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:32.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:32.375+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:33.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:33.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:33.399 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:33.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:34.307 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:34.299+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:34.410 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:34.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:35.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:35.303+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:35.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:35.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:36.305 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:36.295+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:36.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:36.419+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:37.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:37.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:37.397 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:37.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:38.288 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:38.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:38.409 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:38.399+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:39.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:39.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:39.364 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:39.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:40.317 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:40.307+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:40.348 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:40.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:41.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:41.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:41.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:41.379+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:42.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:42.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:42.350 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:42.339+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:43.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:43.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:43.313 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:43.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:44.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:44.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:44.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:44.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:45.238 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:45.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:45.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:45.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:46.229 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:46.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:46.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:46.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:47.253 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:47.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:47.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:47.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:48.220 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:48.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:48.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:48.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:49.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:49.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:49.221 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:49.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:50.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:50.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:50.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:50.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:51.181 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:51.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:51.237 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:51.227+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:52.141 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:52.131+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:52.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:52.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:53.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:53.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:53.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:53.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:54.196 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:54.187+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:54.219 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:54.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:55.187 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:55.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:55.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:55.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:56.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:56.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:56.237 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:56.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:57.143 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:57.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:57.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:57.219+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:58.172 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:58.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:58.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:58.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:59.152 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:56:59.142+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:56:59.241 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:56:59.230+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:00.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:00.162+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:00.268 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:00.258+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:01.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:01.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:01.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:01.218+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:02.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:02.202+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:02.264 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:02.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:03.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:03.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:03.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:03.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:04.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:04.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:04.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:04.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:05.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:05.230+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:05.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:05.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:06.212 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:06.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:06.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:06.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:07.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:07.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:07.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:07.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:08.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:08.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:08.331 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:08.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:09.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:09.242+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:09.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:09.334+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:10.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:10.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:10.319 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:10.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:11.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:11.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:11.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:11.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:12.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:12.250+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:12.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:12.322+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:13.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:13.258+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:13.350 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:13.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:14.261 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:14.254+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:14.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:14.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:15.269 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:15.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:15.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:15.350+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:16.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:16.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:16.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:16.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:17.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:17.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:17.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:17.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:18.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:18.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:18.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:18.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:19.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:19.234+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:19.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:19.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:20.201 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:20.194+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:20.249 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:20.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:21.208 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:21.202+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:21.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:21.282+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:22.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:22.206+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:22.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:22.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:23.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:23.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:23.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:23.250+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:24.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:24.282+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:24.302 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:24.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:25.273 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:25.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:25.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:25.286+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:26.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:26.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:26.299 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:26.294+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:27.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:27.246+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:27.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:27.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:28.222 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:28.214+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:28.308 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:28.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:29.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:29.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:29.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:29.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:30.276 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:30.270+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:30.321 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:30.314+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:31.246 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:31.238+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:31.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:31.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:32.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:32.278+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:32.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:32.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:33.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:33.262+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:33.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:33.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:34.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:34.290+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:34.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:34.290+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:35.303 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:35.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:35.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:35.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:36.278 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:36.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:36.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:36.298+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:37.274 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:37.266+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:37.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:37.298+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:38.232 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:38.226+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:38.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:38.254+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:39.276 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:39.269+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:39.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:39.269+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:40.254 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:40.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:40.272 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:40.265+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:41.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:41.249+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:41.266 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:41.257+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:42.233 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:42.225+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:42.314 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:42.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:43.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:43.237+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:43.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:43.301+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:44.280 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:44.273+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:44.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:44.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:45.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:45.253+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:45.349 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:45.341+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:46.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:46.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:46.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:46.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:47.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:47.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:47.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:47.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:48.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:48.245+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:48.370 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:48.361+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:49.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:49.277+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:49.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:49.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:50.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:50.261+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:50.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:50.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:51.306 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:51.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:51.464 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:51.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:52.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:52.297+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:52.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:52.469+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:53.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:53.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:53.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:53.433+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:54.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:54.329+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:54.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:54.417+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:55.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:55.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:55.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:55.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:56.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:56.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:56.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:56.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:57.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:57.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:57.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:57.377+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:58.361 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:58.353+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:58.398 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:58.389+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:59.379 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:57:59.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:57:59.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:57:59.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:00.390 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:00.381+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:00.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:00.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:01.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:01.393+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:01.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:01.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:02.424 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:02.417+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:02.546 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:02.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:03.467 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:03.461+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:03.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:03.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:04.441 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:04.433+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:04.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:04.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:05.429 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:05.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:05.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:05.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:06.382 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:06.373+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:06.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:06.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:07.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:07.349+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:07.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:07.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:08.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:08.365+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:08.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:08.481+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:09.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:09.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:09.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:09.517+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:10.455 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:10.449+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:10.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:10.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:11.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:11.429+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:11.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:11.533+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:12.416 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:12.409+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:12.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:12.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:13.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:13.421+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:13.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:13.505+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:14.385 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:14.377+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:14.468 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:14.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:15.347 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:15.341+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:15.469 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:15.461+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:16.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:16.293+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:16.460 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:16.453+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:17.332 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:17.325+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:17.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:17.441+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:18.354 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:18.345+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:18.472 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:18.465+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:19.327 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:19.321+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:19.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:19.477+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:20.316 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:20.309+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:20.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:20.525+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:21.270 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:21.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:21.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:21.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:22.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:22.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:22.567 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:22.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:23.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:23.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:23.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:23.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:24.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:24.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:24.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:24.608+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:25.253 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:25.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:25.624 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:25.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:26.205 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:26.196+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:26.577 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:26.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:27.231 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:27.224+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:27.592 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:27.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:28.243 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:28.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:28.584 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:28.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:29.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:29.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:29.587 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:29.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:30.277 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:30.268+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:30.539 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:30.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:31.248 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:31.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:31.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:31.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:32.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:32.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:32.521 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:32.512+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:33.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:33.240+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:33.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:33.520+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:34.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:34.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:34.502 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:34.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:35.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:35.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:35.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:35.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:36.337 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:36.328+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:36.487 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:36.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:37.329 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:37.320+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:37.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:37.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:38.304 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:38.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:38.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:38.488+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:39.281 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:39.272+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:39.505 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:39.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:40.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:40.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:40.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:40.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:41.255 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:41.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:41.558 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:41.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:42.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:42.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:42.532 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:42.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:43.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:43.260+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:43.500 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:43.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:44.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:44.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:44.453 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:44.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:45.258 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:45.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:45.486 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:45.476+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:46.217 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:46.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:46.507 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:46.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:47.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:47.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:47.545 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:47.536+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:48.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:48.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:48.527 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:48.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:49.226 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:49.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:49.576 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:49.568+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:50.254 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:50.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:50.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:50.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:51.239 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:51.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:51.504 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:51.496+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:52.252 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:52.244+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:52.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:52.472+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:53.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:53.204+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:53.435 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:53.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:54.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:54.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:54.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:54.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:55.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:55.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:55.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:55.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:56.138 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:56.128+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:56.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:56.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:57.144 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:57.136+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:57.466 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:57.456+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:58.158 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:58.148+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:58.511 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:58.504+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:59.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:58:59.120+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:58:59.488 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:58:59.480+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:00.107 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:00.100+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:00.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:00.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:01.102 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:01.092+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:01.509 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:01.500+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:02.121 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:02.112+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:02.483 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:02.471+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:03.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:03.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:03.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:03.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:04.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:04.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:04.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:04.487+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:05.189 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:05.179+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:05.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:05.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:06.234 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:06.223+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:06.436 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:06.427+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:07.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:07.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:07.444 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:07.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:08.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:08.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:08.446 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:08.435+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:09.228 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:09.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:09.477 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:09.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:10.273 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:10.263+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:10.490 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:10.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:11.265 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:11.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:11.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:11.491+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:12.249 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:12.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:12.462 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:12.451+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:13.262 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:13.251+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:13.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:13.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:14.267 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:14.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:14.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:14.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:15.275 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:15.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:15.489 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:15.479+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:16.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:16.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:16.492 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:16.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:17.363 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:17.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:17.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:17.443+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:18.338 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:18.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:18.479 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:18.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:19.356 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:19.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:19.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:19.467+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:20.367 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:20.355+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:20.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:20.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:21.334 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:21.323+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:21.508 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:21.499+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:22.340 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:22.331+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:22.473 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:22.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:23.305 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:23.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:23.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:23.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:24.298 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:24.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:24.463 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:24.455+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:25.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:25.295+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:25.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:25.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:26.319 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:26.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:26.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:26.391+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:27.288 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:27.279+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:27.417 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:27.407+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:28.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:28.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:28.384 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:28.375+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:29.339 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:29.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:29.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:29.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:30.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:30.327+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:30.362 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:30.351+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:31.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:31.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:31.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:31.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:32.345 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:32.335+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:32.397 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:32.387+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:33.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:33.315+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:33.432 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:33.423+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:34.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:34.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:34.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:34.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:35.321 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:35.311+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:35.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:35.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:36.297 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:36.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:36.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:36.463+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:37.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:37.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:37.523 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:37.515+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:38.295 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:38.287+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:38.494 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:38.483+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:39.335 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:39.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:39.467 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:39.459+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:40.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:40.367+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:40.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:40.415+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:41.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:41.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:41.441 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:41.431+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:42.396 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:42.387+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:42.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:42.419+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:43.402 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:43.391+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:43.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:43.403+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:44.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:44.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:44.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:44.422+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:45.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:45.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:45.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:45.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:46.373 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:46.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:46.409 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:46.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:47.372 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:47.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:47.378 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:47.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:48.372 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:48.362+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:48.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:48.362+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:49.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:49.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:49.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:49.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:50.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:50.310+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:50.446 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:50.434+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:51.351 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:51.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:51.406 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:51.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:52.316 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:52.306+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:52.383 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:52.370+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:53.281 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:53.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:53.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:53.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:54.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:54.270+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:54.453 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:54.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:55.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:55.326+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:55.479 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:55.470+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:56.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:56.338+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:56.497 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:56.490+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:57.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:57.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:57.528 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:57.522+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:58.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:58.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:58.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:58.518+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:59.309 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T07:59:59.302+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T07:59:59.535 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T07:59:59.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:00.301 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:00.294+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:00.492 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:00.486+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:01.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:01.342+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:01.534 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:01.526+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:02.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:02.386+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:02.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:02.534+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:03.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:03.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:03.579 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:03.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:04.424 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:04.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:04.537 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:04.530+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:05.425 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:05.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:05.568 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:05.562+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:06.387 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:06.378+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:06.584 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:06.578+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:07.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:07.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:07.615 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:07.606+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:08.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:08.374+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:08.623 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:08.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:09.413 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:09.406+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:09.576 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:09.570+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:10.447 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:10.442+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:10.595 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:10.586+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:11.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:11.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:11.605 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:11.598+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:12.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:12.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:12.631 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:12.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:13.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:13.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:13.661 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:13.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:14.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:14.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:14.704 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:14.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:15.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:15.570+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:15.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:15.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:16.616 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:16.610+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:16.792 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:16.786+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:17.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:17.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:17.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:17.814+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:18.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:18.674+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:18.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:18.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:19.664 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:19.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:19.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:19.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:20.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:20.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:20.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:20.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:21.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:21.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:21.826 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:21.818+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:22.778 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:22.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:22.780 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:22.774+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:23.757 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:23.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:23.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:23.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:24.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:24.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:24.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:24.774+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:25.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:25.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:25.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:25.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:26.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:26.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:26.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:26.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:27.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:27.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:27.795 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:27.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:28.750 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:28.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:28.836 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:28.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:29.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:29.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:29.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:29.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:30.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:30.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:30.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:30.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:31.752 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:31.745+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:31.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:31.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:32.791 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:32.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:32.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:32.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:33.779 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:33.769+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:33.962 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:33.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:34.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:34.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:34.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:34.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:35.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:35.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:35.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:35.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:36.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:36.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:36.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:36.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:37.863 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:37.853+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:37.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:37.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:38.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:38.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:38.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:38.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:39.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:39.901+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:39.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:39.985+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:40.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:40.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:40.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:40.953+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:41.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:41.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:41.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:41.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:42.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:42.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:42.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:42.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:43.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:43.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:43.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:43.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:44.901 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:44.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:44.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:44.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:45.870 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:45.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:45.971 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:45.965+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:46.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:46.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:47.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:46.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:47.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:47.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:48.008 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:48.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:48.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:48.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:48.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:48.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:49.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:49.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:49.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:49.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:50.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:50.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:51.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:50.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:51.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:51.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:51.995 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:51.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:52.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:52.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:53.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:53.001+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:53.872 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:53.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:54.046 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:54.037+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:54.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:54.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:55.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:55.065+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:55.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:55.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:56.033 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:56.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:56.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:56.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:56.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:56.989+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:57.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:57.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:57.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:57.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:58.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:58.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:58.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:58.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:59.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:00:59.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:00:59.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:00:59.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:00.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:00.829+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:00.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:00.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:01.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:01.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:01.931 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:01.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:02.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:02.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:02.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:02.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:03.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:03.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:03.892 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:03.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:04.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:04.809+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:04.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:04.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:05.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:05.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:05.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:05.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:06.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:06.757+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:06.919 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:06.909+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:07.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:07.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:07.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:07.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:08.796 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:08.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:08.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:08.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:09.750 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:09.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:09.972 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:09.964+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:10.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:10.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:10.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:10.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:11.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:11.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:11.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:11.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:12.756 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:12.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:12.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:12.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:13.751 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:13.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:13.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:13.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:14.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:14.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:14.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:14.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:15.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:15.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:15.944 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:15.936+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:16.814 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:16.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:16.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:16.960+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:17.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:17.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:17.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:17.952+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:18.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:18.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:18.916 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:18.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:19.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:19.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:19.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:19.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:20.900 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:20.892+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:20.902 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:20.892+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:21.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:21.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:21.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:21.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:22.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:22.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:22.880 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:22.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:23.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:23.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:23.889 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:23.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:24.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:24.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:24.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:24.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:25.833 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:25.824+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:25.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:25.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:26.849 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:26.840+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:26.864 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:26.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:27.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:27.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:27.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:27.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:28.847 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:28.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:28.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:28.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:29.884 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:29.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:29.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:29.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:30.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:30.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:30.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:30.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:31.912 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:31.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:31.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:31.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:32.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:32.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:32.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:32.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:33.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:33.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:33.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:33.932+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:34.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:34.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:34.921 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:34.912+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:35.894 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:35.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:35.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:35.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:36.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:36.880+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:36.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:36.944+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:37.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:37.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:37.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:37.900+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:38.860 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:38.852+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:38.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:38.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:39.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:39.828+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:39.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:39.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:40.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:40.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:40.868 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:40.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:41.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:41.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:41.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:41.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:42.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:42.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:42.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:42.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:43.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:43.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:43.874 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:43.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:44.845 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:44.836+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:44.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:44.848+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:45.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:45.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:45.854 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:45.844+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:46.876 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:46.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:46.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:46.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:47.881 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:47.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:47.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:47.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:48.834 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:48.823+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:48.927 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:48.915+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:49.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:49.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:49.973 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:49.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:50.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:50.831+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:51.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:50.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:51.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:51.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:52.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:52.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:52.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:52.875+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:53.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:53.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:53.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:53.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:54.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:53.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:54.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:54.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:54.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:54.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:55.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:55.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:56.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:56.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:56.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:56.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:56.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:56.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:57.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:57.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:58.022 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:58.011+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:58.983 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:58.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:59.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:01:59.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:01:59.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:01:59.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:00.049 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:00.039+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:00.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:00.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:01.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:01.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:01.974 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:01.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:02.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:02.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:02.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:02.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:03.001 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:02.991+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:03.954 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:03.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:03.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:03.971+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:04.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:04.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:04.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:04.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:05.910 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:05.899+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:05.940 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:05.931+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:06.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:06.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:06.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:06.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:07.954 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:07.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:08.014 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:08.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:08.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:08.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:08.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:08.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:09.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:09.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:09.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:09.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:10.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:10.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:10.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:10.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:11.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:11.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:11.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:11.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:12.907 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:12.895+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:12.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:12.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:13.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:13.935+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:13.969 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:13.959+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:14.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:14.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:14.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:14.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:15.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:15.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:16.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:16.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:16.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:16.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:17.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:16.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:17.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:17.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:18.030 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:18.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:18.925 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:18.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:19.065 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:19.055+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:19.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:19.951+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:20.018 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:20.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:20.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:20.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:21.069 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:21.059+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:21.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:21.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:22.061 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:22.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:22.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:22.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:23.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:23.007+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:23.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:23.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:24.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:23.999+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:25.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:25.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:25.026 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:25.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:25.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:25.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:26.035 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:26.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:26.995 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:26.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:27.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:27.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:28.017 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:28.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:28.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:28.047+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:28.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:28.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:29.074 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:29.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:30.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:30.019+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:30.032 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:30.023+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:31.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:31.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:31.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:31.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:31.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:31.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:32.034 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:32.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:32.985 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:32.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:33.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:33.042+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:33.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:33.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:34.081 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:34.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:34.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:34.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:35.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:35.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:35.989 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:35.978+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:36.055 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:36.046+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:37.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:37.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:37.039 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:37.026+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:37.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:37.982+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:37.993 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:37.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:39.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:38.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:39.031 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:39.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:39.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:39.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:40.009 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:39.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:40.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:40.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:40.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:40.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:41.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:41.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:42.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:42.022+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:42.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:42.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:43.019 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:43.010+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:43.960 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:43.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:43.979 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:43.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:44.942 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:44.934+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:44.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:44.990+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:45.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:45.906+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:45.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:45.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:46.911 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:46.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:47.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:47.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:47.873 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:47.866+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:48.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:48.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:48.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:48.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:49.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:49.030+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:49.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:49.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:50.066 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:50.058+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:50.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:50.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:51.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:51.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:51.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:51.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:51.984 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:51.978+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:52.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:52.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:52.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:52.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:53.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:53.838+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:53.903 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:53.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:54.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:54.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:54.945 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:54.938+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:55.783 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:55.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:55.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:55.902+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:56.801 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:56.794+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:56.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:56.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:57.839 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:57.830+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:57.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:57.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:58.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:58.786+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:58.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:58.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:59.776 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:02:59.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:02:59.886 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:02:59.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:00.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:00.734+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:00.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:00.862+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:01.705 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:01.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:01.854 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:01.846+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:02.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:02.726+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:02.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:02.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:03.704 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:03.698+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:03.804 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:03.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:04.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:04.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:04.771 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:04.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:05.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:05.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:05.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:05.782+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:06.770 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:06.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:06.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:06.778+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:07.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:07.722+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:07.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:07.766+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:08.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:08.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:08.733 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:08.726+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:09.716 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:09.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:09.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:09.742+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:10.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:10.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:10.760 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:10.754+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:11.715 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:11.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:11.784 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:11.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:12.741 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:12.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:12.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:12.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:13.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:13.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:13.767 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:13.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:14.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:14.701+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:14.738 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:14.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:15.670 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:15.661+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:15.751 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:15.741+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:16.697 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:16.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:16.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:16.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:17.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:17.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:17.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:17.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:18.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:18.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:18.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:18.757+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:19.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:19.665+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:19.743 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:19.737+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:20.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:20.669+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:20.720 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:20.713+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:21.696 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:21.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:21.729 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:21.721+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:22.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:22.709+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:22.737 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:22.729+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:23.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:23.685+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:23.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:23.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:24.674 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:24.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:24.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:24.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:25.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:25.617+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:25.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:25.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:26.642 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:26.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:26.788 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:26.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:27.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:27.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:27.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:27.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:28.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:28.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:28.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:28.797+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:29.661 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:29.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:29.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:29.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:30.682 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:30.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:30.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:30.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:31.668 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:31.661+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:31.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:31.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:32.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:32.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:32.693 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:32.685+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:33.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:33.653+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:33.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:33.701+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:34.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:34.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:34.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:34.705+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:35.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:35.705+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:35.742 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:35.733+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:36.697 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:36.689+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:36.698 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:36.689+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:37.707 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:37.697+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:37.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:37.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:38.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:38.681+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:38.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:38.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:39.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:39.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:39.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:39.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:40.659 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:40.649+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:40.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:40.761+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:41.653 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:41.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:41.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:41.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:42.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:42.641+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:42.747 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:42.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:43.680 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:43.673+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:43.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:43.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:44.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:44.669+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:44.746 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:44.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:45.672 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:45.665+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:45.743 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:45.737+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:46.654 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:46.645+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:46.726 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:46.717+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:47.662 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:47.653+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:47.734 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:47.725+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:48.643 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:48.633+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:48.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:48.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:49.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:49.637+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:49.763 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:49.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:50.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:50.589+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:50.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:50.713+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:51.562 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:51.553+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:51.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:51.753+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:52.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:52.549+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:52.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:52.769+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:53.519 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:53.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:53.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:53.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:54.525 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:54.516+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:54.764 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:54.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:55.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:55.528+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:55.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:55.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:56.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:56.560+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:56.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:56.740+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:57.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:57.540+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:57.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:57.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:58.534 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:58.524+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:58.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:58.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:59.559 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:03:59.548+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:03:59.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:03:59.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:00.552 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:00.544+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:00.765 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:00.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:01.580 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:01.572+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:01.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:01.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:02.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:02.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:02.797 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:02.788+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:03.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:03.600+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:03.773 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:03.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:04.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:04.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:04.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:04.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:05.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:05.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:05.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:05.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:06.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:06.656+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:06.779 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:06.768+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:07.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:07.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:07.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:07.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:08.677 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:08.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:08.761 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:08.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:09.632 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:09.624+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:09.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:09.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:10.648 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:10.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:10.723 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:10.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:11.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:11.688+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:11.712 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:11.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:12.658 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:12.648+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:12.725 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:12.716+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:13.681 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:13.672+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:13.767 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:13.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:14.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:14.668+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:14.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:14.784+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:15.673 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:15.664+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:15.839 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:15.828+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:16.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:16.620+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:16.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:16.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:17.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:17.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:17.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:17.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:18.595 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:18.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:18.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:18.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:19.594 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:19.584+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:19.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:19.748+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:20.636 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:20.628+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:20.713 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:20.704+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:21.599 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:21.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:21.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:21.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:22.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:22.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:22.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:22.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:23.647 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:23.636+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:23.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:23.732+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:24.601 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:24.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:24.766 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:24.756+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:25.603 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:25.592+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:25.744 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:25.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:26.560 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:26.552+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:26.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:26.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:27.586 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:27.576+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:27.753 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:27.744+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:28.605 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:28.596+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:28.800 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:28.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:29.597 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:29.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:29.810 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:29.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:30.564 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:30.556+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:30.762 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:30.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:31.596 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:31.588+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:31.774 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:31.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:32.625 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:32.616+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:32.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:32.776+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:33.650 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:33.640+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:33.789 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:33.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:34.640 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:34.632+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:34.745 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:34.736+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:35.629 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:35.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:35.786 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:35.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:36.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:36.615+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:36.748 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:36.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:37.621 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:37.611+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:37.787 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:37.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:38.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:38.623+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:38.806 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:38.795+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:39.644 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:39.635+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:39.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:39.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:40.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:40.619+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:40.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:40.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:41.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:41.667+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:41.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:41.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:42.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:42.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:42.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:42.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:43.706 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:43.695+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:43.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:43.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:44.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:44.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:45.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:45.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:45.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:45.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:46.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:46.055+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:46.723 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:46.715+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:47.111 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:47.099+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:47.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:47.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:48.129 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:48.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:48.744 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:48.735+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:49.147 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:49.135+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:49.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:49.767+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:50.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:50.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:50.773 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:50.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:51.182 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:51.171+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:51.792 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:51.783+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:52.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:52.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:52.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:52.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:53.174 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:53.163+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:53.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:53.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:54.223 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:54.211+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:54.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:54.755+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:55.203 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:55.191+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:55.733 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:55.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:56.227 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:56.219+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:56.701 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:56.691+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:57.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:57.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:57.739 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:57.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:58.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:58.207+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:58.695 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:58.687+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:59.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:04:59.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:04:59.718 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:04:59.707+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:00.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:00.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:00.684 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:00.675+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:01.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:01.151+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:01.713 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:01.703+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:02.194 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:02.183+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:02.734 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:02.723+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:03.225 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:03.215+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:03.740 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:03.731+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:04.186 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:04.175+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:04.735 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:04.727+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:05.166 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:05.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:05.721 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:05.711+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:06.215 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:06.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:06.690 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:06.679+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:07.257 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:07.247+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:07.665 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:07.655+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:08.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:08.255+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:08.671 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:08.663+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:09.293 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:09.283+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:09.663 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:09.651+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:10.302 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:10.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:10.709 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:10.699+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:11.317 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:11.307+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:11.758 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:11.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:12.336 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:12.327+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:12.749 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:12.739+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:13.328 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:13.319+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:13.798 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:13.787+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:14.314 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:14.303+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:14.756 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:14.747+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:15.359 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:15.347+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:15.754 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:15.743+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:16.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:16.383+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:16.775 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:16.763+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:17.438 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:17.426+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:17.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:17.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:18.407 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:18.394+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:18.768 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:18.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:19.423 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:19.410+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:19.731 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:19.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:20.386 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:20.374+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:20.764 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:20.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:21.377 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:21.366+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:21.753 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:21.742+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:22.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:22.378+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:22.759 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:22.746+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:23.400 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:23.390+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:23.763 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:23.750+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:24.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:24.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:24.774 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:24.762+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:25.433 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:25.422+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:25.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:25.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:26.452 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:26.442+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:26.812 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:26.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:27.443 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:27.430+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:27.802 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:27.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:28.473 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:28.462+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:28.831 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:28.822+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:29.521 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:29.514+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:29.817 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:29.810+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:30.552 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:30.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:30.777 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:30.770+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:31.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:31.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:31.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:31.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:32.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:32.618+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:32.725 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:32.718+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:33.662 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:33.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:33.679 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:33.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:34.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:34.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:34.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:34.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:35.683 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:35.678+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:35.687 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:35.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:36.635 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:36.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:36.736 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:36.730+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:37.615 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:37.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:37.739 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:37.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:38.570 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:38.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:38.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:38.754+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:39.609 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:39.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:39.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:39.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:40.598 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:40.590+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:40.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:40.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:41.613 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:41.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:41.722 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:41.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:42.633 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:42.626+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:42.727 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:42.718+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:43.656 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:43.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:43.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:43.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:44.646 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:44.638+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:44.776 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:44.770+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:45.676 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:45.670+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:45.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:45.798+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:46.630 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:46.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:46.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:46.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:47.614 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:47.606+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:47.768 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:47.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:48.611 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:48.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:48.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:48.806+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:49.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:49.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:49.837 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:49.830+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:50.556 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:50.550+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:50.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:50.858+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:51.537 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:51.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:51.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:51.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:52.496 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:52.490+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:52.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:52.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:53.481 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:53.474+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:53.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:53.914+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:54.470 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:54.462+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:54.931 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:54.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:55.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:55.494+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:55.884 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:55.878+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:56.538 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:56.530+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:56.846 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:56.838+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:57.533 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:57.526+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:57.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:57.842+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:58.549 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:58.542+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:58.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:58.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:59.569 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:05:59.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:05:59.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:05:59.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:00.530 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:00.521+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:00.844 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:00.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:01.503 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:01.493+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:01.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:01.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:02.518 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:02.509+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:02.821 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:02.813+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:03.568 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:03.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:03.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:03.861+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:04.583 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:04.577+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:04.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:04.857+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:05.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:05.581+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:05.897 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:05.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:06.578 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:06.569+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:06.862 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:06.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:07.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:07.561+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:07.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:07.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:08.544 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:08.537+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:08.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:08.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:09.497 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:09.489+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:09.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:09.889+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:10.465 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:10.457+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:10.907 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:10.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:11.456 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:11.449+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:11.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:11.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:12.408 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:12.401+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:12.885 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:12.877+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:13.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:13.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:13.921 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:13.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:14.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:14.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:14.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:14.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:15.312 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:15.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:15.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:15.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:16.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:16.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:16.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:16.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:17.377 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:17.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:17.932 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:17.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:18.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:18.409+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:18.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:18.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:19.438 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:19.429+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:19.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:19.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:20.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:20.421+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:20.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:20.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:21.434 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:21.425+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:21.948 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:21.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:22.421 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:22.413+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:22.902 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:22.893+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:23.394 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:23.385+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:23.930 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:23.921+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:24.358 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:24.349+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:24.890 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:24.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:25.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:25.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:25.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:25.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:26.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:26.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:26.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:26.917+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:27.361 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:27.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:27.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:27.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:28.380 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:28.373+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:28.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:28.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:29.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:29.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:29.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:29.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:30.335 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:30.325+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:31.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:30.993+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:31.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:31.345+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:31.982 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:31.973+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:32.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:32.353+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:33.008 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:33.001+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:33.346 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:33.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:34.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:34.041+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:34.324 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:34.317+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:35.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:34.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:35.315 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:35.305+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:35.959 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:35.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:36.291 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:36.285+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:36.968 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:36.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:37.257 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:37.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:37.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:37.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:38.297 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:38.289+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:38.947 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:38.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:39.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:39.249+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:39.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:39.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:40.224 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:40.217+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:40.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:40.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:41.209 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:41.200+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:41.896 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:41.888+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:42.163 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:42.156+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:42.914 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:42.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:43.115 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:43.104+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:43.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:43.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:44.099 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:44.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:44.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:44.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:45.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:45.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:45.950 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:45.940+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:46.140 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:46.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:46.911 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:46.900+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:47.189 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:47.180+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:47.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:47.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:48.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:48.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:48.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:48.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:49.125 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:49.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:49.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:49.884+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:50.124 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:50.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:50.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:50.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:51.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:51.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:51.926 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:51.916+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:52.106 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:52.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:52.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:52.964+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:53.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:53.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:53.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:53.948+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:54.122 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:54.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:54.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:54.988+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:55.158 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:55.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:56.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:55.996+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:56.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:56.172+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:56.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:56.968+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:57.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:57.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:57.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:57.984+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:58.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:58.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:59.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:06:59.016+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:06:59.157 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:06:59.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:00.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:00.044+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:00.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:00.112+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:01.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:01.040+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:01.159 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:01.148+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:02.089 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:02.080+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:02.143 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:02.132+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:03.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:03.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:03.134 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:03.124+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:04.076 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:04.068+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:04.125 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:04.116+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:05.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:05.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:05.167 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:05.156+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:06.057 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:06.048+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:06.218 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:06.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:07.067 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:07.056+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:07.244 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:07.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:08.105 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:08.096+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:08.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:08.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:09.088 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:09.080+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:09.245 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:09.236+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:10.127 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:10.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:10.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:10.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:11.152 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:11.144+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:11.219 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:11.208+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:12.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:12.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:12.256 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:12.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:13.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:13.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:13.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:13.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:14.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:14.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:14.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:14.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:15.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:15.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:15.192 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:15.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:16.039 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:16.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:16.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:16.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:17.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:17.024+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:17.181 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:17.172+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:18.070 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:18.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:18.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:18.220+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:19.097 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:19.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:19.241 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:19.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:20.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:20.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:20.211 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:20.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:21.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:21.124+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:21.240 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:21.232+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:22.137 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:22.127+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:22.268 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:22.259+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:23.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:23.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:23.301 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:23.291+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:24.147 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:24.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:24.278 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:24.267+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:25.176 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:25.167+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:25.251 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:25.239+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:26.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:26.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:26.214 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:26.203+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:27.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:27.095+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:27.177 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:27.167+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:28.134 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:28.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:28.164 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:28.155+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:29.120 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:29.111+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:29.135 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:29.123+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:30.131 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:30.119+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:30.145 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:30.135+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:31.101 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:31.091+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:31.123 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:31.111+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:32.093 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:32.083+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:32.131 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:32.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:33.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:33.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:33.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:33.075+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:34.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:34.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:34.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:34.063+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:35.045 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:35.035+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:35.057 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:35.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:36.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:36.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:36.091 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:36.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:37.027 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:37.015+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:37.094 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:37.083+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:38.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:38.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:38.055 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:38.043+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:39.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:39.051+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:39.063 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:39.051+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:40.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:40.027+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:40.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:40.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:41.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:41.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:41.086 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:41.075+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:41.999 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:41.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:42.069 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:42.059+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:42.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:42.955+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:43.059 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:43.047+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:44.015 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:44.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:44.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:44.011+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:44.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:44.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:45.032 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:45.023+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:45.927 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:45.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:46.027 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:46.015+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:46.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:46.927+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:47.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:47.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:47.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:47.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:47.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:47.979+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:48.980 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:48.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:49.014 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:49.003+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:49.988 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:49.975+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:50.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:49.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:50.952 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:50.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:51.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:51.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:51.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:51.987+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:52.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:52.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:52.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:52.959+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:53.043 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:53.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:53.975 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:53.963+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:54.072 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:54.063+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:54.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:54.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:55.031 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:55.019+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:55.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:55.919+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:55.992 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:55.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:56.951 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:56.943+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:56.999 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:56.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:57.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:57.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:58.045 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:58.035+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:58.948 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:58.939+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:59.049 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:07:59.039+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:07:59.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:07:59.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:00.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:00.003+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:00.958 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:00.947+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:00.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:00.971+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:01.953 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:01.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:01.962 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:01.951+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:02.924 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:02.915+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:02.937 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:02.927+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:03.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:03.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:03.920 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:03.910+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:04.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:04.922+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:04.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:04.946+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:05.961 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:05.950+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:05.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:05.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:06.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:06.930+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:06.983 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:06.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:07.964 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:07.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:07.984 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:07.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:08.963 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:08.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:08.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:08.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:09.950 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:09.938+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:10.021 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:10.010+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:10.909 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:10.898+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:11.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:10.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:11.865 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:11.854+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:12.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:11.994+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:12.914 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:12.902+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:13.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:13.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:13.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:13.894+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:14.011 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:13.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:14.935 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:14.926+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:15.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:15.034+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:15.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:15.970+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:16.067 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:16.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:16.967 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:16.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:17.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:17.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:17.960 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:17.954+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:18.022 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:18.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:18.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:18.966+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:18.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:18.982+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:19.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:19.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:20.013 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:20.006+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:20.928 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:20.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:21.050 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:21.042+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:21.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:21.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:22.010 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:22.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:23.015 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:23.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:23.058 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:23.050+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:24.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:24.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:24.109 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:24.102+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:25.077 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:25.070+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:25.085 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:25.078+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:26.047 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:26.038+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:26.087 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:26.078+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:27.007 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:26.998+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:27.097 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:27.090+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:28.000 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:27.994+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:28.060 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:28.054+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:29.011 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:29.002+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:29.024 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:29.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:29.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:29.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:29.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:29.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:30.924 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:30.918+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:31.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:30.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:31.969 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:31.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:32.028 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:32.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:32.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:32.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:33.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:33.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:33.959 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:33.950+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:34.030 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:34.022+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:34.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:34.946+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:35.025 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:35.018+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:35.966 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:35.958+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:36.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:36.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:36.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:36.942+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:37.009 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:37.002+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:37.968 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:37.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:37.981 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:37.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:38.970 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:38.962+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:39.013 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:39.006+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:39.997 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:39.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:40.023 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:40.014+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:40.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:40.970+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:41.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:41.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:41.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:41.942+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:42.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:42.014+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:42.966 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:42.958+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:42.996 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:42.990+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:43.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:43.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:43.993 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:43.986+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:44.981 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:44.974+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:45.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:44.998+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:45.933 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:45.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:45.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:45.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:46.934 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:46.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:46.980 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:46.973+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:47.908 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:47.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:47.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:47.985+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:48.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:48.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:48.957 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:48.949+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:49.912 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:49.905+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:50.002 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:49.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:50.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:50.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:51.003 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:50.993+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:51.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:51.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:52.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:52.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:52.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:52.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:53.016 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:53.009+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:53.955 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:53.945+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:54.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:54.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:54.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:54.941+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:54.991 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:54.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:55.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:55.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:56.020 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:56.013+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:56.957 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:56.949+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:57.048 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:57.041+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:57.920 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:57.913+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:58.034 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:58.025+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:58.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:58.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:59.054 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:08:59.045+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:08:59.939 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:08:59.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:00.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:00.061+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:00.893 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:00.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:01.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:01.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:01.849 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:01.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:02.121 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:02.113+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:02.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:02.837+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:03.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:03.141+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:03.861 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:03.853+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:04.117 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:04.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:04.825 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:04.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:05.108 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:05.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:05.852 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:05.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:06.139 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:06.129+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:06.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:06.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:07.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:07.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:07.853 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:07.845+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:08.110 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:08.101+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:08.858 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:08.849+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:09.119 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:09.109+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:09.889 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:09.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:10.129 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:10.121+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:10.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:10.925+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:11.168 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:11.161+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:11.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:11.957+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:12.161 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:12.153+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:12.972 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:12.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:13.212 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:13.205+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:13.977 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:13.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:14.202 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:14.193+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:15.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:14.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:15.231 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:15.221+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:16.036 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:16.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:16.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:16.245+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:17.065 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:17.057+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:17.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:17.273+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:18.113 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:18.105+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:18.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:18.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:19.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:19.153+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:19.378 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:19.369+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:20.213 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:20.205+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:20.345 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:20.337+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:21.176 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:21.169+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:21.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:21.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:22.139 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:22.129+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:22.329 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:22.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:23.180 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:23.173+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:23.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:23.281+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:24.230 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:24.221+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:24.336 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:24.329+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:25.242 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:25.233+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:25.328 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:25.321+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:26.210 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:26.201+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:26.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:26.313+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:27.163 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:27.152+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:27.373 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:27.364+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:28.195 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:28.184+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:28.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:28.356+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:29.197 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:29.188+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:29.403 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:29.392+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:30.191 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:30.180+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:30.362 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:30.352+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:31.200 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:31.192+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:31.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:31.360+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:32.209 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:32.200+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:32.418 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:32.408+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:33.224 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:33.216+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:33.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:33.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:34.259 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:34.248+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:34.478 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:34.468+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:35.284 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:35.276+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:35.439 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:35.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:36.266 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:36.256+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:36.430 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:36.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:37.300 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:37.292+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:37.386 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:37.376+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:38.323 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:38.312+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:38.437 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:38.428+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:39.296 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:39.288+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:39.474 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:39.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:40.309 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:40.300+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:40.501 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:40.492+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:41.307 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:41.296+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:41.458 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:41.448+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:42.343 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:42.332+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:42.475 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:42.464+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:43.357 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:43.348+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:43.431 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:43.420+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:44.394 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:44.384+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:44.452 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:44.444+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:45.371 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:45.360+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:45.433 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:45.424+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:46.355 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:46.344+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:46.407 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:46.396+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:47.381 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:47.372+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:47.391 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:47.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:48.339 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:48.332+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:48.435 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:48.424+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:49.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:49.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:49.449 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:49.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:50.304 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:50.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:50.448 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:50.440+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:51.348 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:51.340+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:51.444 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:51.436+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:52.337 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:52.328+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:52.474 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:52.464+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:53.326 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:53.308+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:53.437 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:53.428+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:54.293 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:54.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:54.389 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:54.380+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:55.332 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:55.324+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:55.430 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:55.420+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:56.296 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:56.288+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:56.451 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:56.444+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:57.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:57.284+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:57.494 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:57.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:58.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:58.272+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:58.493 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:58.484+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:59.300 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:09:59.292+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:09:59.486 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:09:59.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:00.306 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:00.296+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:00.484 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:00.476+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:01.290 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:01.280+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:01.525 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:01.516+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:02.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:02.256+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:02.573 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:02.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:03.261 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:03.252+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:03.548 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:03.540+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:04.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:04.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:04.541 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:04.532+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:05.204 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:05.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:05.572 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:05.564+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:06.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:06.244+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:06.589 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:06.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:07.286 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:07.276+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:07.590 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:07.580+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:08.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:08.236+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:08.618 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:08.608+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:09.259 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:09.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:09.611 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:09.603+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:10.213 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:10.203+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:10.622 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:10.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:11.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:11.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:11.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:11.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:12.182 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:12.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:12.604 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:12.595+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:13.199 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:13.187+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:13.637 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:13.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:14.248 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:14.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:14.624 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:14.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:15.267 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:15.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:15.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:15.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:16.265 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:16.255+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:16.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:16.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:17.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:17.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:17.653 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:17.643+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:18.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:18.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:18.610 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:18.599+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:19.186 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:19.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:19.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:19.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:20.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:20.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:20.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:20.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:21.258 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:21.247+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:21.640 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:21.631+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:22.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:22.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:22.656 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:22.647+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:23.289 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:23.279+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:23.638 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:23.627+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:24.320 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:24.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:24.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:24.623+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:25.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:25.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:25.673 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:25.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:26.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:26.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:26.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:26.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:27.359 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:27.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:27.627 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:27.615+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:28.344 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:28.335+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:28.620 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:28.611+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:29.357 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:29.347+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:29.647 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:29.635+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:30.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:30.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:30.674 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:30.663+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:31.342 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:31.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:31.710 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:31.699+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:32.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:32.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:32.716 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:32.707+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:33.379 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:33.367+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:33.749 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:33.739+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:34.392 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:34.383+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:34.741 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:34.731+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:35.366 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:35.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:35.754 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:35.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:36.353 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:36.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:36.714 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:36.703+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:37.389 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:37.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:37.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:37.743+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:38.420 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:38.411+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:38.784 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:38.775+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:39.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:39.399+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:39.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:39.763+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:40.383 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:40.371+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:40.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:40.803+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:41.390 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:41.379+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:41.838 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:41.827+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:42.352 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:42.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:42.883 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:42.871+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:43.360 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:43.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:43.857 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:43.847+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:44.333 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:44.323+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:44.817 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:44.807+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:45.341 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:45.331+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:45.848 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:45.839+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:46.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:46.355+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:46.829 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:46.819+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:47.363 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:47.351+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:47.798 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:47.787+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:48.323 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:48.311+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:48.759 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:48.747+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:49.354 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:49.343+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:49.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:49.771+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:50.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:50.319+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:50.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:50.722+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:51.340 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:51.330+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:51.701 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:51.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:52.330 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:52.318+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:52.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:52.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:53.364 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:53.354+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:53.634 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:53.622+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:54.371 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:54.358+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:54.677 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:54.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:55.405 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:55.394+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:55.650 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:55.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:56.423 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:56.410+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:56.643 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:56.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:57.429 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:57.418+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:57.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:57.678+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:58.457 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:58.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:58.668 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:58.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:59.411 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:10:59.398+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:10:59.719 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:10:59.706+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:00.451 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:00.438+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:00.742 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:00.734+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:01.495 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:01.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:01.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:01.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:02.454 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:02.446+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:02.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:02.750+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:03.493 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:03.486+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:03.752 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:03.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:04.514 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:04.506+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:04.770 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:04.762+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:05.541 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:05.534+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:05.755 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:05.746+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:06.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:06.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:06.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:06.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:07.555 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:07.546+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:07.700 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:07.694+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:08.589 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:08.582+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:08.660 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:08.654+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:09.571 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:09.562+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:09.665 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:09.658+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:10.575 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:10.566+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:10.621 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:10.614+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:11.575 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:11.566+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:11.602 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:11.594+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:12.554 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:12.546+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:12.608 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:12.602+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:13.566 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:13.558+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:13.626 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:13.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:14.601 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:14.594+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:14.667 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:14.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:15.627 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:15.618+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:15.633 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:15.626+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:16.641 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:16.634+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:16.645 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:16.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:17.628 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:17.622+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:17.639 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:17.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:18.636 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:18.630+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:18.657 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:18.650+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:19.646 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:19.638+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:19.666 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:19.658+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:20.695 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:20.686+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:20.696 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:20.690+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:21.691 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:21.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:21.722 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:21.714+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:22.672 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:22.666+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:22.719 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:22.710+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:23.688 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:23.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:23.745 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:23.738+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:24.699 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:24.690+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:24.788 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:24.782+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:25.705 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:25.698+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:25.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:25.826+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:26.721 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:26.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:26.808 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:26.802+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:27.679 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:27.670+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:27.785 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:27.778+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:28.720 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:28.714+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:28.807 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:28.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:29.690 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:29.682+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:29.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:29.798+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:30.649 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:30.642+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:30.765 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:30.758+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:31.671 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:31.662+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:31.796 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:31.790+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:32.707 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:32.697+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:32.811 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:32.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:33.757 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:33.749+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:33.786 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:33.777+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:34.737 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:34.729+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:34.809 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:34.801+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:35.740 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:35.733+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:35.793 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:35.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:36.790 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:36.781+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:36.794 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:36.785+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:37.789 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:37.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:37.835 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:37.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:38.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:38.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:38.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:38.801+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:39.790 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:39.781+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:39.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:39.793+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:40.815 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:40.805+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:40.834 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:40.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:41.793 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:41.785+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:41.832 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:41.825+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:42.772 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:42.765+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:42.804 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:42.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:43.780 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:43.773+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:43.818 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:43.809+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:44.824 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:44.817+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:44.828 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:44.821+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:45.825 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:45.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:45.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:45.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:46.815 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:46.805+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:46.840 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:46.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:47.843 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:47.833+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:47.843 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:47.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:48.805 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:48.797+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:48.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:48.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:49.840 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:49.833+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:49.874 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:49.865+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:50.826 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:50.817+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:50.850 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:50.841+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:51.848 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:51.841+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:51.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:51.885+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:52.877 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:52.869+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:52.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:52.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:53.857 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:53.849+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:53.892 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:53.881+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:54.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:54.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:54.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:54.897+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:55.893 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:55.885+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:55.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:55.937+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:56.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:56.901+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:56.913 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:56.905+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:57.937 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:57.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:57.947 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:57.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:58.923 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:58.913+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:58.971 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:58.961+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:59.891 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:11:59.881+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:11:59.941 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:11:59.933+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:00.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:00.877+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:00.979 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:00.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:01.846 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:01.837+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:01.975 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:01.965+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:02.897 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:02.889+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:03.012 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:03.005+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:03.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:03.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:04.052 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:04.045+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:04.945 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:04.937+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:05.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:05.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:05.955 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:05.945+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:06.076 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:06.069+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:06.940 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:06.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:07.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:07.029+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:07.990 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:07.981+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:08.007 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:07.997+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:08.943 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:08.933+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:08.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:08.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:09.930 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:09.921+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:09.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:09.969+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:10.938 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:10.929+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:10.939 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:10.929+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:11.916 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:11.909+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:11.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:11.925+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:12.880 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:12.873+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:12.965 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:12.957+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:13.833 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:13.825+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:13.994 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:13.984+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:14.801 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:14.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:14.949 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:14.940+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:15.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:15.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:15.934 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:15.924+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:16.827 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:16.816+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:16.917 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:16.908+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:17.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:17.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:17.886 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:17.876+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:18.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:18.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:18.869 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:18.860+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:19.809 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:19.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:19.905 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:19.896+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:20.822 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:20.812+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:20.915 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:20.904+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:21.807 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:21.796+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:21.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:21.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:22.802 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:22.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:22.879 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:22.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:23.781 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:23.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:23.875 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:23.864+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:24.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:24.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:24.856 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:24.848+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:25.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:25.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:25.895 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:25.884+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:26.878 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:26.868+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:26.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:26.880+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:27.863 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:27.852+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:27.883 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:27.872+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:28.816 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:28.808+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:28.926 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:28.916+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:29.845 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:29.836+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:29.938 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:29.928+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:30.869 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:30.860+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:30.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:30.948+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:31.841 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:31.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:31.956 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:31.944+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:32.812 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:32.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:32.998 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:32.988+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:33.775 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:33.764+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:34.023 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:34.012+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:34.732 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:34.724+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:35.071 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:35.060+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:35.760 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:35.752+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:36.037 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:36.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:36.769 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:36.760+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:37.029 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:37.020+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:37.813 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:37.804+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:38.038 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:38.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:38.783 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:38.772+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:39.040 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:39.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:39.808 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:39.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:40.072 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:40.064+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:40.842 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:40.832+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:41.036 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:41.028+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:41.803 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:41.792+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:42.026 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:42.016+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:42.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:42.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:43.062 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:43.052+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:43.791 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:43.780+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:44.096 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:44.088+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:44.811 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:44.800+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:45.103 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:45.092+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:45.830 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:45.820+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:46.080 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:46.072+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:46.867 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:46.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:47.118 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:47.108+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:47.906 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:47.896+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:48.092 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:48.084+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:48.913 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:48.904+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:49.126 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:49.116+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:49.963 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:49.952+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:50.111 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:50.100+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:50.919 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:50.908+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:51.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:51.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:51.879 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:51.868+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:52.136 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:52.128+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:52.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:52.912+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:53.144 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:53.136+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:53.882 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:53.872+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:54.179 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:54.168+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:54.866 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:54.856+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:55.206 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:55.196+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:55.891 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:55.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:56.200 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:56.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:56.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:56.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:57.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:57.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:57.944 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:57.935+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:58.247 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:58.235+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:58.965 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:58.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:59.226 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:12:59.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:12:59.978 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:12:59.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:00.180 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:00.171+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:01.010 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:00.999+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:01.222 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:01.211+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:01.976 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:01.967+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:02.205 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:02.195+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:03.019 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:03.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:03.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:03.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:03.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:03.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:04.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:04.199+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:04.973 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:04.963+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:05.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:05.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:05.996 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:05.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:06.162 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:06.151+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:06.985 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:06.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:07.175 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:07.163+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:08.000 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:07.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:08.130 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:08.119+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:09.018 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:09.007+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:09.154 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:09.143+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:10.038 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:10.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:10.149 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:10.139+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:10.991 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:10.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:11.171 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:11.159+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:11.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:11.955+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:12.185 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:12.175+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:13.006 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:12.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:13.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:13.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:14.002 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:13.991+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:14.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:14.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:14.990 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:14.979+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:15.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:15.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:16.042 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:16.031+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:16.191 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:16.179+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:17.037 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:17.027+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:17.216 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:17.207+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:17.994 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:17.983+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:18.227 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:18.215+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:18.988 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:18.975+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:19.250 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:19.239+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:20.005 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:19.995+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:20.298 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:20.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:20.997 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:20.987+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:21.255 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:21.243+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:21.956 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:21.947+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:22.295 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:22.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:22.952 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:22.943+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:23.271 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:23.259+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:23.923 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:23.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:24.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:24.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:24.922 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:24.911+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:25.262 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:25.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:25.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:25.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:26.240 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:26.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:26.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:26.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:27.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:27.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:27.949 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:27.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:28.203 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:28.191+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:28.951 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:28.939+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:29.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:29.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:29.909 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:29.899+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:30.236 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:30.227+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:30.868 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:30.859+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:31.260 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:31.251+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:31.860 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:31.851+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:32.299 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:32.287+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:32.878 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:32.867+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:33.292 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:33.283+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:33.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:33.895+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:34.282 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:34.271+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:34.873 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:34.863+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:35.243 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:35.231+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:35.888 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:35.879+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:36.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:36.263+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:36.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:36.919+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:37.232 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:37.223+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:37.904 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:37.890+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:38.280 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:38.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:38.936 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:38.926+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:39.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:39.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:39.986 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:39.974+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:40.279 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:40.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:40.967 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:40.954+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:41.251 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:41.238+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:41.933 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:41.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:42.208 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:42.198+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:42.905 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:42.894+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:43.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:43.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:43.898 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:43.886+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:44.272 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:44.262+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:44.895 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:44.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:45.239 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:45.226+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:45.876 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:45.866+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:46.225 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:46.214+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:46.894 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:46.882+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:47.246 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:47.234+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:47.910 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:47.898+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:48.252 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:48.242+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:48.917 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:48.910+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:49.234 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:49.222+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:49.929 INFO:tasks.ceph.osd.0.smithi163.stderr:2023-05-20T08:13:49.922+0000 7fa5c2c0d700 -1 osd.0 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:6666 3.3 3:c70342a2:::rbd_data.1084ba82a156.000000000000003a:head [write 2854912~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:50.275 INFO:tasks.ceph.osd.1.smithi163.stderr:2023-05-20T08:13:50.266+0000 7eff7c2c1700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4231.0:7196 3.2 3:728d3074:::rbd_data.1084ba82a156.0000000000000099:head [write 544768~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e25) 2023-05-20T08:13:50.386 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-20T08:13:50.422 DEBUG:teuthology.task.console_log:Killing console logger for smithi163 2023-05-20T08:13:50.422 DEBUG:teuthology.exit:Finished running handlers